[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:42:59 dist-test-slave-8hhm krb5kdc[11822](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:42:59 dist-test-slave-8hhm krb5kdc[11822](info): set up 2 sockets
Aug 07 06:42:59 dist-test-slave-8hhm krb5kdc[11822](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 06:43:01.321761 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.444s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:01 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:01.456211 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:38053
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:43237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:38053
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:01.579311 11842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:01.579604 11842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:01.579651 11842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:01.580994 11842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:01.581071 11842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:01.581095 11842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:01.581116 11842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:01.581146 11842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:01.583247 11842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:38053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:38053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:01.583712 11842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:01.584007 11842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:01.590957 11847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:01.591025 11842 server_base.cc:1034] running on GCE node
W20260807 06:43:01.591104 11848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:01.591723 11852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:01.592073 11842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:01.592485 11842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:01.593660 11842 hybrid_clock.cc:648] HybridClock initialized: now 1786084981593621 us; error 58 us; skew 500 ppm
Aug 07 06:43:01 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084981, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:01.597373 11842 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:01.598104 11842 webserver.cc:460] Webserver started at http://127.11.137.190:36901/ using document root <none> and password file <none>
I20260807 06:43:01.598433 11842 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:01.598513 11842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:01.598719 11842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:01.600193 11842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "02d8111aaebe40759a8305f7496e374a"
format_stamp: "Formatted at 2026-08-07 06:43:01 on dist-test-slave-8hhm"
server_key: "00c50a32964c3651d650d49de1769534"
server_key_iv: "0f22a9099e40ed7e4123afa4aa58c5a6"
server_key_version: "encryptionkey@0"
I20260807 06:43:01.600605 11842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "02d8111aaebe40759a8305f7496e374a"
format_stamp: "Formatted at 2026-08-07 06:43:01 on dist-test-slave-8hhm"
server_key: "00c50a32964c3651d650d49de1769534"
server_key_iv: "0f22a9099e40ed7e4123afa4aa58c5a6"
server_key_version: "encryptionkey@0"
I20260807 06:43:01.602797 11842 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260807 06:43:01.603884 11865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:01.604193 11842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:01.604311 11842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "02d8111aaebe40759a8305f7496e374a"
format_stamp: "Formatted at 2026-08-07 06:43:01 on dist-test-slave-8hhm"
server_key: "00c50a32964c3651d650d49de1769534"
server_key_iv: "0f22a9099e40ed7e4123afa4aa58c5a6"
server_key_version: "encryptionkey@0"
I20260807 06:43:01.604394 11842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:01.625682 11842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:01.628011 11842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:01.628255 11842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:01.638967 11842 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:38053
I20260807 06:43:01.639047 11945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:38053 every 8 connection(s)
I20260807 06:43:01.639719 11842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:01.642648 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11842
I20260807 06:43:01.642851 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:01.643580 11814 external_mini_cluster.cc:1428] Setting key 2aef2018bc661c7bfc7afeb7cb5cbf1e
I20260807 06:43:01.645490 11946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:01.655519 11946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a: Bootstrap starting.
I20260807 06:43:01.659349 11946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:01.659758 11946 log.cc:824] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:43:01 dist-test-slave-8hhm krb5kdc[11822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:01.662225 11946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a: No bootstrap required, opened a new log
I20260807 06:43:01.666338 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:01.647392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37644 (local address 127.11.137.190:38053)
0807 06:43:01.647721 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:01.647729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:01.647779 (+ 50us) server_negotiation.cc:407] Connection header received
0807 06:43:01.649938 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:01.649947 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:01.650071 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:01.650217 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:01.652802 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:01.654010 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:01.655320 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:01.655801 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:01.655886 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:01.660854 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:01.660863 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:01.660863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:01.660874 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:01.663796 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:01.664233 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:01.664237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:01.664238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:01.664366 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:01.664940 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:01.664941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:01.664941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:01.665312 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:01.665430 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:01.665847 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 06:43:01.666060 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":109,"threads_started":1}
I20260807 06:43:01.666421 11946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02d8111aaebe40759a8305f7496e374a" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38053 } }
I20260807 06:43:01.666648 11946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:01.666754 11946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d8111aaebe40759a8305f7496e374a, State: Initialized, Role: FOLLOWER
I20260807 06:43:01.666878 11946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02d8111aaebe40759a8305f7496e374a" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38053 } }
I20260807 06:43:01.667086 11946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:01.667136 11946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:01.667198 11946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:01.679904 11946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02d8111aaebe40759a8305f7496e374a" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38053 } }
I20260807 06:43:01.680176 11946 leader_election.cc:302] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02d8111aaebe40759a8305f7496e374a; no voters:
I20260807 06:43:01.680493 11946 leader_election.cc:288] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:01.680719 11952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:01.681041 11952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [term 1 LEADER]: Becoming Leader. State: Replica: 02d8111aaebe40759a8305f7496e374a, State: Running, Role: LEADER
I20260807 06:43:01.681073 11946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:01.681389 11952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02d8111aaebe40759a8305f7496e374a" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38053 } }
I20260807 06:43:01.682459 11954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02d8111aaebe40759a8305f7496e374a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02d8111aaebe40759a8305f7496e374a" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38053 } } }
I20260807 06:43:01.682585 11954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:01.682840 11958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02d8111aaebe40759a8305f7496e374a. Latest consensus state: current_term: 1 leader_uuid: "02d8111aaebe40759a8305f7496e374a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02d8111aaebe40759a8305f7496e374a" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38053 } } }
I20260807 06:43:01.682909 11958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:01.683468 11970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:01.684523 11970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:01.686667 11970 catalog_manager.cc:1347] Generated new cluster ID: 17375051c4c947c783210c3ce59ad371
I20260807 06:43:01.686738 11970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:01.719798 11970 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:01.720441 11970 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:01.725119 11970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02d8111aaebe40759a8305f7496e374a: Generated new TSK 0
I20260807 06:43:01.725350 11970 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
W20260807 06:43:02.274130 11814 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.137.129: real 0.538s user 0.000s sys 0.004s
I20260807 06:43:02.274439 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:38053
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:43237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:02.402472 11983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:02.402774 11983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:02.402818 11983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:02.404222 11983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:02.404286 11983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:02.404335 11983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:02.406034 11983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:38053
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:02.406401 11983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:02.406705 11983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:02.412967 11989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:02.412976 11988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:02.413038 11992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:02.413395 11983 server_base.cc:1034] running on GCE node
I20260807 06:43:02.413554 11983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:02.413759 11983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:02.414942 11983 hybrid_clock.cc:648] HybridClock initialized: now 1786084982414913 us; error 43 us; skew 500 ppm
Aug 07 06:43:02 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084982, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:02.417672 11983 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:02.418097 11983 webserver.cc:460] Webserver started at http://127.11.137.129:46799/ using document root <none> and password file <none>
I20260807 06:43:02.418339 11983 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:02.418408 11983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:02.418560 11983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:02.419628 11983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "4c0a03854eb84624b05a4ee12d1db27e"
format_stamp: "Formatted at 2026-08-07 06:43:02 on dist-test-slave-8hhm"
server_key: "6920e6971201c9840a61f60694c1d185"
server_key_iv: "dc93783072b056fd847a52ca6d0552f8"
server_key_version: "encryptionkey@0"
I20260807 06:43:02.420053 11983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "4c0a03854eb84624b05a4ee12d1db27e"
format_stamp: "Formatted at 2026-08-07 06:43:02 on dist-test-slave-8hhm"
server_key: "6920e6971201c9840a61f60694c1d185"
server_key_iv: "dc93783072b056fd847a52ca6d0552f8"
server_key_version: "encryptionkey@0"
I20260807 06:43:02.421689 11983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260807 06:43:02.422920 12000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:02.423166 11983 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:43:02.423282 11983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "4c0a03854eb84624b05a4ee12d1db27e"
format_stamp: "Formatted at 2026-08-07 06:43:02 on dist-test-slave-8hhm"
server_key: "6920e6971201c9840a61f60694c1d185"
server_key_iv: "dc93783072b056fd847a52ca6d0552f8"
server_key_version: "encryptionkey@0"
I20260807 06:43:02.423359 11983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:02.433966 11983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:02.436311 11983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:02.436477 11983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:02.436771 11983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:02.437165 11983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:02.437307 11983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:02.437353 11983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:02.437379 11983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:02.444983 11983 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:33289
I20260807 06:43:02.445070 12169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:33289 every 8 connection(s)
I20260807 06:43:02.445452 11983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:02.450971 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11983
I20260807 06:43:02.451054 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:02.451212 11814 external_mini_cluster.cc:1428] Setting key 430accbd382be3ae204bdc2cbeebfbaf
Aug 07 06:43:02 dist-test-slave-8hhm krb5kdc[11822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084982, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:02.456594 12173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:02.446473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:37755 (local address 127.11.137.190:38053)
0807 06:43:02.447281 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:02.447283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:02.447289 (+ 6us) server_negotiation.cc:407] Connection header received
0807 06:43:02.447341 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:02.447342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:02.447357 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:02.447420 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:02.448601 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:02.449188 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:02.450201 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:02.450468 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:02.450548 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:02.453272 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:02.453273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:02.453274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:02.453289 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:02.455204 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:02.455615 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:02.455617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:02.455617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:02.455694 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:02.455941 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:02.455942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:02.455942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:02.456116 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:02.456197 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:02.456441 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 06:43:02.456512 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":72,"threads_started":1}
I20260807 06:43:02.456827 12172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:02.446396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:38053 (local address 127.11.137.129:37755)
0807 06:43:02.446634 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:02.446673 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:02.447146 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:02.447510 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:02.447514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:02.448296 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:02.448500 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:02.448505 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:02.449297 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:02.449298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:02.450093 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:02.450095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:02.450565 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:02.450566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:02.450669 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:02.451316 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:02.451328 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:02.453135 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:02.455292 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:02.455300 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:02.455302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:02.455537 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:02.455762 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:02.455763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:02.455764 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:02.455870 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:02.456194 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:02.456200 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:02.456317 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 06:43:02.456407 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:43:02.456540 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":121,"threads_started":1}
I20260807 06:43:02.457417 12170 heartbeater.cc:347] Connected to a master server at 127.11.137.190:38053
I20260807 06:43:02.457530 12170 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:02.457744 12170 heartbeater.cc:511] Master 127.11.137.190:38053 requested a full tablet report, sending...
I20260807 06:43:02.458645 11883 ts_manager.cc:194] Registered new tserver with Master: 4c0a03854eb84624b05a4ee12d1db27e (127.11.137.129:33289)
I20260807 06:43:02.459565 11883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:37755
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
W20260807 06:43:03.147204 11814 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.137.130: real 0.695s user 0.000s sys 0.004s
I20260807 06:43:03.147985 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:38053
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:43237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:03.231698 12176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:03.231945 12176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:03.231992 12176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:03.233109 12176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:03.233170 12176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:03.233213 12176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:03.234704 12176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:38053
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:03.234963 12176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:03.235198 12176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:03.240760 12187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:03.240769 12184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:03.240770 12182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:03.241020 12176 server_base.cc:1034] running on GCE node
I20260807 06:43:03.241320 12176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:03.241604 12176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:03.242769 12176 hybrid_clock.cc:648] HybridClock initialized: now 1786084983242748 us; error 40 us; skew 500 ppm
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:03.245493 12176 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:03.245988 12176 webserver.cc:460] Webserver started at http://127.11.137.130:42505/ using document root <none> and password file <none>
I20260807 06:43:03.246181 12176 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:03.246220 12176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:03.246315 12176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:03.247496 12176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "0a39d56ceab5450ab4a2d31f77881f2c"
format_stamp: "Formatted at 2026-08-07 06:43:03 on dist-test-slave-8hhm"
server_key: "98764bb2c32216d7b51c4e37f3b5358e"
server_key_iv: "8f7ef0e57161b5ff564750607baf906c"
server_key_version: "encryptionkey@0"
I20260807 06:43:03.247844 12176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "0a39d56ceab5450ab4a2d31f77881f2c"
format_stamp: "Formatted at 2026-08-07 06:43:03 on dist-test-slave-8hhm"
server_key: "98764bb2c32216d7b51c4e37f3b5358e"
server_key_iv: "8f7ef0e57161b5ff564750607baf906c"
server_key_version: "encryptionkey@0"
I20260807 06:43:03.249361 12176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:03.250155 12196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:03.250319 12176 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:03.250437 12176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "0a39d56ceab5450ab4a2d31f77881f2c"
format_stamp: "Formatted at 2026-08-07 06:43:03 on dist-test-slave-8hhm"
server_key: "98764bb2c32216d7b51c4e37f3b5358e"
server_key_iv: "8f7ef0e57161b5ff564750607baf906c"
server_key_version: "encryptionkey@0"
I20260807 06:43:03.250558 12176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:03.262241 12176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:03.264775 12176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:03.264884 12176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:03.265082 12176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:03.265440 12176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:03.265476 12176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:03.265520 12176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:03.265548 12176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:03.272369 12176 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:36683
I20260807 06:43:03.272432 12349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:36683 every 8 connection(s)
I20260807 06:43:03.272768 12176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:03.273962 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12176
I20260807 06:43:03.274044 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:03.274206 11814 external_mini_cluster.cc:1428] Setting key b25c6198e9083cfd9f36641dd99f1fa4
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
I20260807 06:43:03.283900 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:03.273677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:34377 (local address 127.11.137.190:38053)
0807 06:43:03.273854 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:03.273857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:03.273876 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:43:03.274622 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:03.274624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:03.274638 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:03.274699 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:03.275767 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.276323 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.277476 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.277687 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.277761 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:03.280508 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:03.280510 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:03.280510 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:03.280518 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:03.282415 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.282845 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.282847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.282847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.282915 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.283160 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.283161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.283161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.283287 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:03.283361 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:03.283669 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 06:43:03.283766 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
I20260807 06:43:03.284060 12352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:03.273583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:38053 (local address 127.11.137.130:34377)
0807 06:43:03.273746 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:03.273796 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:03.274511 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:03.274771 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:03.274775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:03.275456 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:03.275657 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:03.275662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.276423 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.276425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:03.277379 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:03.277381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.277769 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.277770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:03.277904 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:03.278502 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:03.278509 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:03.280402 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:03.282499 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:03.282507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:03.282509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:03.282770 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:03.282969 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:03.282970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:03.282970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:03.283077 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:03.283364 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:03.283371 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:03.283514 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 06:43:03.283626 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 06:43:03.283788 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260807 06:43:03.284533 12350 heartbeater.cc:347] Connected to a master server at 127.11.137.190:38053
I20260807 06:43:03.284613 12350 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:03.284770 12350 heartbeater.cc:511] Master 127.11.137.190:38053 requested a full tablet report, sending...
I20260807 06:43:03.285137 11883 ts_manager.cc:194] Registered new tserver with Master: 0a39d56ceab5450ab4a2d31f77881f2c (127.11.137.130:36683)
I20260807 06:43:03.285532 11883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:34377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:03.345844 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:38053
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:43237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:03.429598 12357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:03.429807 12357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:03.429831 12357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:03.431033 12357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:03.431084 12357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:03.431135 12357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:03.432642 12357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:38053
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:03.432898 12357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:03.433143 12357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:03.438349 12365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:03.438426 12370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:03.438457 12357 server_base.cc:1034] running on GCE node
W20260807 06:43:03.438352 12367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:03.438865 12357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:03.439113 12357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:03.440303 12357 hybrid_clock.cc:648] HybridClock initialized: now 1786084983440291 us; error 45 us; skew 500 ppm
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:03.442905 12357 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:03.443390 12357 webserver.cc:460] Webserver started at http://127.11.137.131:43867/ using document root <none> and password file <none>
I20260807 06:43:03.443639 12357 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:03.443709 12357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:03.443859 12357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:03.445160 12357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "a1c9e0a8973a446a809b2bf262e1b379"
format_stamp: "Formatted at 2026-08-07 06:43:03 on dist-test-slave-8hhm"
server_key: "cf72dd07ca9842d6e3d9b0b8ae5a2d8f"
server_key_iv: "dd89583334a219d1eb12111c0e29cb23"
server_key_version: "encryptionkey@0"
I20260807 06:43:03.445621 12357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "a1c9e0a8973a446a809b2bf262e1b379"
format_stamp: "Formatted at 2026-08-07 06:43:03 on dist-test-slave-8hhm"
server_key: "cf72dd07ca9842d6e3d9b0b8ae5a2d8f"
server_key_iv: "dd89583334a219d1eb12111c0e29cb23"
server_key_version: "encryptionkey@0"
I20260807 06:43:03.447249 12357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:03.447978 12379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:03.448149 12357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:03.448257 12357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "a1c9e0a8973a446a809b2bf262e1b379"
format_stamp: "Formatted at 2026-08-07 06:43:03 on dist-test-slave-8hhm"
server_key: "cf72dd07ca9842d6e3d9b0b8ae5a2d8f"
server_key_iv: "dd89583334a219d1eb12111c0e29cb23"
server_key_version: "encryptionkey@0"
I20260807 06:43:03.448330 12357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:03.460680 12170 heartbeater.cc:503] Master 127.11.137.190:38053 was elected leader, sending a full tablet report...
I20260807 06:43:03.464552 12357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:03.466426 12357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:03.466543 12357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:03.466725 12357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:03.467108 12357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:03.467151 12357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:03.467190 12357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:03.467218 12357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:03.474399 12357 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:41679
I20260807 06:43:03.474462 12542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:41679 every 8 connection(s)
I20260807 06:43:03.474773 12357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:03.481289 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12357
I20260807 06:43:03.481396 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:03.481607 11814 external_mini_cluster.cc:1428] Setting key e558f72de0b268fcc9f39a92847007a5
I20260807 06:43:03.484401 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:03.475599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:35617 (local address 127.11.137.190:38053)
0807 06:43:03.475683 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:03.475685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:03.475859 (+ 174us) server_negotiation.cc:407] Connection header received
0807 06:43:03.476364 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:03.476365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:03.476375 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:03.476424 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:03.477364 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.477862 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.478820 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.479080 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.479136 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:03.481444 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:03.481445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:03.481446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:03.481454 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:03.483025 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.483484 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.483485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.483485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.483546 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.483807 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.483809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.483809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.483944 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:03.484013 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:03.484249 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 06:43:03.484336 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:43:03.484534 12545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:03.475556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:38053 (local address 127.11.137.131:35617)
0807 06:43:03.475738 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:03.475775 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:03.476281 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:03.476487 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:03.476490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:03.477066 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:03.477288 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:03.477293 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.477943 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.477943 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:03.478742 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:03.478744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.479158 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.479159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:03.479279 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:03.479840 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:03.479848 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:03.481326 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:03.483113 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:03.483120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:03.483122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:03.483420 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:03.483605 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:03.483606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:03.483606 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:03.483719 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:03.484015 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:03.484020 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:03.484133 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 06:43:03.484220 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 06:43:03.484349 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":104,"threads_started":1}
I20260807 06:43:03.484990 12543 heartbeater.cc:347] Connected to a master server at 127.11.137.190:38053
I20260807 06:43:03.485072 12543 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:03.485313 12543 heartbeater.cc:511] Master 127.11.137.190:38053 requested a full tablet report, sending...
I20260807 06:43:03.485728 11883 ts_manager.cc:194] Registered new tserver with Master: a1c9e0a8973a446a809b2bf262e1b379 (127.11.137.131:41679)
I20260807 06:43:03.486093 11883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:35617
I20260807 06:43:03.493575 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:03.517194 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:03.510037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35424 (local address 127.11.137.129:33289)
0807 06:43:03.510220 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:03.510225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:03.510235 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:03.510259 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:03.510261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:03.510274 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:03.510333 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:03.510899 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.511584 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.512276 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.512575 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.512628 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:03.514739 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:03.514748 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:03.514748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:03.514754 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:03.516202 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.516520 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.516522 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.516522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.516578 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.516743 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.516744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.516744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.516863 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:03.516975 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:03.517048 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 06:43:03.517111 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":109,"threads_started":1}
W20260807 06:43:03.517689 12045 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35424
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[11822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:03.545030 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:03.536662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35436 (local address 127.11.137.129:33289)
0807 06:43:03.536728 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:03.536730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:03.536954 (+ 224us) server_negotiation.cc:407] Connection header received
0807 06:43:03.536979 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:03.536979 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:03.536990 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:03.537027 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:03.537753 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.538362 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.539225 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:03.539458 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:03.539539 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:03.542013 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:03.542015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:03.542015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:03.542023 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:03.543867 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.544233 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.544234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.544235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.544302 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:03.544508 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:03.544509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:03.544509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:03.544619 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:03.544743 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:03.544842 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 06:43:03.544926 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:43:03.545572 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11983
I20260807 06:43:03.570573 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12176
I20260807 06:43:03.590099 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12357
I20260807 06:43:03.616400 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11842
2026-08-07T06:43:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3775 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[12562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[12562](info): set up 2 sockets
Aug 07 06:43:03 dist-test-slave-8hhm krb5kdc[12562](info): commencing operation
krb5kdc: starting...
W20260807 06:43:04.867069 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:04 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:04.996752 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36953
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:36953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:05.080286 12578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:05.080525 12578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:05.080559 12578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:05.081697 12578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:05.081763 12578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:05.081786 12578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:05.081812 12578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:05.081872 12578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:05.083439 12578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:36953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:05.083729 12578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:05.083950 12578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:05.089056 12583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:05.089149 12578 server_base.cc:1034] running on GCE node
W20260807 06:43:05.089133 12584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:05.089138 12586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:05.089582 12578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:05.089880 12578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:05.091019 12578 hybrid_clock.cc:648] HybridClock initialized: now 1786084985091018 us; error 40 us; skew 500 ppm
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:05.096376 12578 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:05.096858 12578 webserver.cc:460] Webserver started at http://127.11.137.190:40375/ using document root <none> and password file <none>
I20260807 06:43:05.097100 12578 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:05.097172 12578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:05.097355 12578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:05.098438 12578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "2d10aaedcd854dd08b758c8b7e971137"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "aeb1df9e7c2cf39f29c6466af14e10f6"
server_key_iv: "f87b7c166e4c498eb8361031b5378fc0"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.098814 12578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "2d10aaedcd854dd08b758c8b7e971137"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "aeb1df9e7c2cf39f29c6466af14e10f6"
server_key_iv: "f87b7c166e4c498eb8361031b5378fc0"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.100205 12578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:05.100912 12596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.101090 12578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:05.101193 12578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "2d10aaedcd854dd08b758c8b7e971137"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "aeb1df9e7c2cf39f29c6466af14e10f6"
server_key_iv: "f87b7c166e4c498eb8361031b5378fc0"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.101329 12578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:05.123075 12578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:05.125613 12578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:05.125802 12578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:05.129997 12578 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:36953
I20260807 06:43:05.130062 12677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:36953 every 8 connection(s)
I20260807 06:43:05.130435 12578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:05.131376 12678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:05.132002 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12578
I20260807 06:43:05.132076 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:05.132256 11814 external_mini_cluster.cc:1428] Setting key 849bf5b45606d9b503ec6c40db643adc
I20260807 06:43:05.134581 12678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137: Bootstrap starting.
I20260807 06:43:05.135280 12678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:05.135640 12678 log.cc:824] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:05.136380 12678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137: No bootstrap required, opened a new log
I20260807 06:43:05.138636 12678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d10aaedcd854dd08b758c8b7e971137" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36953 } }
I20260807 06:43:05.138797 12678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:05.138845 12678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d10aaedcd854dd08b758c8b7e971137, State: Initialized, Role: FOLLOWER
I20260807 06:43:05.138993 12678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d10aaedcd854dd08b758c8b7e971137" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36953 } }
I20260807 06:43:05.139081 12678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:05.139127 12678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:05.139179 12678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:05.139817 12678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d10aaedcd854dd08b758c8b7e971137" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36953 } }
I20260807 06:43:05.139931 12678 leader_election.cc:302] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d10aaedcd854dd08b758c8b7e971137; no voters:
I20260807 06:43:05.140115 12678 leader_election.cc:288] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:05.140202 12685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:05.140345 12685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [term 1 LEADER]: Becoming Leader. State: Replica: 2d10aaedcd854dd08b758c8b7e971137, State: Running, Role: LEADER
I20260807 06:43:05.140416 12678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:05.140443 12685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d10aaedcd854dd08b758c8b7e971137" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36953 } }
I20260807 06:43:05.140828 12685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d10aaedcd854dd08b758c8b7e971137. Latest consensus state: current_term: 1 leader_uuid: "2d10aaedcd854dd08b758c8b7e971137" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d10aaedcd854dd08b758c8b7e971137" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36953 } } }
I20260807 06:43:05.140894 12686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d10aaedcd854dd08b758c8b7e971137" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d10aaedcd854dd08b758c8b7e971137" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36953 } } }
I20260807 06:43:05.140980 12685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:05.141927 12686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137 [sys.catalog]: This master's current role is: LEADER
W20260807 06:43:05.142426 12706 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:43:05.142485 12706 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:43:05.142632 12707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:05.142871 12707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:05.143930 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.132829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56470 (local address 127.11.137.190:36953)
0807 06:43:05.133032 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.133043 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.133081 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:43:05.133627 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.133636 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.133699 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.133857 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.134424 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.135815 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.136669 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.137305 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.137417 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.139867 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.139871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.139872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.139884 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.142261 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.142716 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.142719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.142720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.142813 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.143032 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.143033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.143034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.143271 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.143415 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.143538 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.143678 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260807 06:43:05.144634 12707 catalog_manager.cc:1347] Generated new cluster ID: ecdba6ce5cc4499b8d1dcd806ce78681
I20260807 06:43:05.144701 12707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:05.162644 12707 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:05.163443 12707 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:05.168685 12707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d10aaedcd854dd08b758c8b7e971137: Generated new TSK 0
I20260807 06:43:05.168880 12707 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:05.202173 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36953
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:05.289520 12716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:05.289748 12716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:05.289790 12716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:05.290951 12716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:05.291023 12716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:05.291071 12716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:05.292618 12716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36953
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:05.292879 12716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:05.293126 12716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:05.298413 12725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:05.298430 12723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:05.298426 12722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:05.298758 12716 server_base.cc:1034] running on GCE node
I20260807 06:43:05.299014 12716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:05.299270 12716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:05.300432 12716 hybrid_clock.cc:648] HybridClock initialized: now 1786084985300423 us; error 38 us; skew 500 ppm
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:05.303216 12716 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:05.303684 12716 webserver.cc:460] Webserver started at http://127.11.137.129:39557/ using document root <none> and password file <none>
I20260807 06:43:05.303962 12716 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:05.304034 12716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:05.304193 12716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:05.305390 12716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "b19335e541774a42b94a2f1faa642b3a"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "6a9eec7a352c1b675c4e5653a83dbee8"
server_key_iv: "28f7a5776699ac7d1d18fd0b1c301bbc"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.305840 12716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "b19335e541774a42b94a2f1faa642b3a"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "6a9eec7a352c1b675c4e5653a83dbee8"
server_key_iv: "28f7a5776699ac7d1d18fd0b1c301bbc"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.307225 12716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:43:05.307976 12737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.308238 12716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:05.308349 12716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "b19335e541774a42b94a2f1faa642b3a"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "6a9eec7a352c1b675c4e5653a83dbee8"
server_key_iv: "28f7a5776699ac7d1d18fd0b1c301bbc"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.308430 12716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:05.339217 12716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:05.341900 12716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:05.342064 12716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:05.342361 12716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:05.342702 12716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:05.342739 12716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.342782 12716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:05.342810 12716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.348786 12716 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:42115
I20260807 06:43:05.348824 12902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:42115 every 8 connection(s)
I20260807 06:43:05.349192 12716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:05.358714 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.350050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:33945 (local address 127.11.137.190:36953)
0807 06:43:05.350118 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.350119 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.350347 (+ 228us) server_negotiation.cc:407] Connection header received
0807 06:43:05.351407 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.351408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.351417 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.351478 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.352104 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.352590 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.353611 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.353813 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.353866 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.356043 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.356045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.356045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.356052 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.357562 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.357925 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.357926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.357926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.357979 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.358191 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.358192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.358192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.358292 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.358344 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.358573 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.358639 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:43:05.358919 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.350009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36953 (local address 127.11.137.129:33945)
0807 06:43:05.350209 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.350253 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.351312 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.351538 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.351541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.351818 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:05.352027 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.352032 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.352678 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.352679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.353537 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.353539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.353891 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.353892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.354032 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.354514 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:05.354522 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:05.355946 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:05.357635 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:05.357641 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:05.357642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:05.357859 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:05.358036 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:05.358037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:05.358037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:05.358135 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:05.358347 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:05.358351 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:05.358463 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.358543 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.358663 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":116,"threads_started":1}
I20260807 06:43:05.358981 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12716
I20260807 06:43:05.359266 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:05.359469 11814 external_mini_cluster.cc:1428] Setting key 40b4c6501f06314d76647c79821794c2
I20260807 06:43:05.359568 12903 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36953
I20260807 06:43:05.359686 12903 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:05.359894 12903 heartbeater.cc:511] Master 127.11.137.190:36953 requested a full tablet report, sending...
I20260807 06:43:05.360507 12624 ts_manager.cc:194] Registered new tserver with Master: b19335e541774a42b94a2f1faa642b3a (127.11.137.129:42115)
I20260807 06:43:05.361176 12624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:33945
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:05.388026 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36953
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:05.471848 12909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:05.472064 12909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:05.472090 12909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:05.473304 12909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:05.473348 12909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:05.473376 12909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:05.474908 12909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36953
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:05.475136 12909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:05.475353 12909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:05.480636 12922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:05.480738 12909 server_base.cc:1034] running on GCE node
W20260807 06:43:05.480608 12917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:05.480639 12918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:05.481091 12909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:05.481427 12909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:05.482597 12909 hybrid_clock.cc:648] HybridClock initialized: now 1786084985482580 us; error 51 us; skew 500 ppm
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:05.485282 12909 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:05.485771 12909 webserver.cc:460] Webserver started at http://127.11.137.130:46451/ using document root <none> and password file <none>
I20260807 06:43:05.485997 12909 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:05.486071 12909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:05.486239 12909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:05.487296 12909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "d355a7ed50d54be7b1f36ac9f9821eb4"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "14596a8f1a4e0b6e440ff56e802534b5"
server_key_iv: "b9e72ef1d7922953dc6be3d8f226a3e6"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.487682 12909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "d355a7ed50d54be7b1f36ac9f9821eb4"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "14596a8f1a4e0b6e440ff56e802534b5"
server_key_iv: "b9e72ef1d7922953dc6be3d8f226a3e6"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.489040 12909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:05.489889 12931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.490073 12909 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:05.490177 12909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "d355a7ed50d54be7b1f36ac9f9821eb4"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "14596a8f1a4e0b6e440ff56e802534b5"
server_key_iv: "b9e72ef1d7922953dc6be3d8f226a3e6"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.490258 12909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:05.512557 12909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:05.514459 12909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:05.514634 12909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:05.514886 12909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:05.515209 12909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:05.515265 12909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.515308 12909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:05.515353 12909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.521181 12909 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:46469
I20260807 06:43:05.521255 13096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:46469 every 8 connection(s)
I20260807 06:43:05.521566 12909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:05.523620 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12909
I20260807 06:43:05.523722 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:05.523923 11814 external_mini_cluster.cc:1428] Setting key 3e7340a5306421446e25df44aa0f1e9f
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:05.532271 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.522264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:35087 (local address 127.11.137.190:36953)
0807 06:43:05.522344 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.522347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.522565 (+ 218us) server_negotiation.cc:407] Connection header received
0807 06:43:05.523588 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.523589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.523601 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.523645 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.524554 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.525093 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.526627 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.526940 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.527028 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.529442 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.529444 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.529444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.529452 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.530836 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.531251 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.531252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.531253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.531320 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.531596 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.531598 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.531598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.531720 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.531795 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.532097 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.532184 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:43:05.532449 13103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.522214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36953 (local address 127.11.137.130:35087)
0807 06:43:05.522409 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.522471 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.523457 (+ 986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.523743 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.523747 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.524148 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:05.524415 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.524421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.525199 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.525201 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.526537 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.526540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.527030 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.527030 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.527127 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.527642 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:05.527653 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:05.529349 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:05.530924 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:05.530931 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:05.530934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:05.531170 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:05.531402 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:05.531403 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:05.531403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:05.531518 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:05.531799 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:05.531807 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:05.531947 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.532060 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.532214 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260807 06:43:05.532944 13100 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36953
I20260807 06:43:05.533036 13100 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:05.533267 13100 heartbeater.cc:511] Master 127.11.137.190:36953 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
I20260807 06:43:05.533715 12624 ts_manager.cc:194] Registered new tserver with Master: d355a7ed50d54be7b1f36ac9f9821eb4 (127.11.137.130:46469)
I20260807 06:43:05.534099 12624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:35087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:05.550652 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36953
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:05.632848 13107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:05.633038 13107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:05.633062 13107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:05.634223 13107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:05.634279 13107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:05.634303 13107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:05.635768 13107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36953
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:05.636014 13107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:05.636314 13107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:05.641295 13120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:05.641319 13114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:05.641350 13115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:05.641628 13107 server_base.cc:1034] running on GCE node
I20260807 06:43:05.641860 13107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:05.642160 13107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:05.643311 13107 hybrid_clock.cc:648] HybridClock initialized: now 1786084985643296 us; error 28 us; skew 500 ppm
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:05.645991 13107 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:05.646358 13107 webserver.cc:460] Webserver started at http://127.11.137.131:34661/ using document root <none> and password file <none>
I20260807 06:43:05.646552 13107 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:05.646601 13107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:05.646687 13107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:05.647682 13107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "b2cfbaa225a84656ae9c12b6236b291a"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "c33d0800c0c8239ae5d27afb32350cb6"
server_key_iv: "bb7090f9585b85b663956eab9d30f175"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.647995 13107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "b2cfbaa225a84656ae9c12b6236b291a"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "c33d0800c0c8239ae5d27afb32350cb6"
server_key_iv: "bb7090f9585b85b663956eab9d30f175"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.649405 13107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:43:05.650125 13132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.650319 13107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:05.650396 13107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "b2cfbaa225a84656ae9c12b6236b291a"
format_stamp: "Formatted at 2026-08-07 06:43:05 on dist-test-slave-8hhm"
server_key: "c33d0800c0c8239ae5d27afb32350cb6"
server_key_iv: "bb7090f9585b85b663956eab9d30f175"
server_key_version: "encryptionkey@0"
I20260807 06:43:05.650450 13107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:05.677318 13107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:05.679180 13107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:05.679314 13107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:05.679520 13107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:05.679768 13107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:05.679800 13107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.679822 13107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:05.679834 13107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:05.685513 13107 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:45213
I20260807 06:43:05.685586 13297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:45213 every 8 connection(s)
I20260807 06:43:05.685925 13107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:05.694862 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.686661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:40093 (local address 127.11.137.190:36953)
0807 06:43:05.686741 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.686743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.686969 (+ 226us) server_negotiation.cc:407] Connection header received
0807 06:43:05.687842 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.687843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.687854 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.687919 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.688475 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.688945 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.689960 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.690186 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.690247 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.692305 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.692306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.692306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.692313 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.693684 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.694119 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.694120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.694120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.694171 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.694383 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.694384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.694384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.694477 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.694528 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.694743 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.694801 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:43:05.695050 13300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.686594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36953 (local address 127.11.137.131:40093)
0807 06:43:05.686819 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.686860 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.687749 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.687973 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.687976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.688223 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:05.688403 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.688407 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.689036 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.689037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.689882 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.689885 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.690265 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.690266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.690360 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.690859 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:05.690867 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:05.692225 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:05.693752 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:05.693758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:05.693760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:05.694059 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:05.694230 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:05.694231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:05.694231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:05.694330 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:05.694531 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:05.694536 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:05.694638 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.694717 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.694825 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":119,"threads_started":1}
I20260807 06:43:05.695669 13298 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36953
I20260807 06:43:05.695779 13298 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:05.695907 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13107
I20260807 06:43:05.695981 13298 heartbeater.cc:511] Master 127.11.137.190:36953 requested a full tablet report, sending...
I20260807 06:43:05.695986 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:05.696175 11814 external_mini_cluster.cc:1428] Setting key e917222aeae209b0cff850d1181f269c
I20260807 06:43:05.696398 12624 ts_manager.cc:194] Registered new tserver with Master: b2cfbaa225a84656ae9c12b6236b291a (127.11.137.131:45213)
I20260807 06:43:05.696825 12624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:40093
I20260807 06:43:05.697009 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:05.704244 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.698728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.11.137.190:36953)
0807 06:43:05.698783 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.698785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.698894 (+ 109us) server_negotiation.cc:407] Connection header received
0807 06:43:05.698930 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.698930 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.698938 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.698986 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.699454 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.699875 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.700571 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.700744 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.700806 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.701911 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.701912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.701912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.701918 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.703097 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.703433 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.703435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.703435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.703502 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.703720 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.703721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.703722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.703872 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.704047 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.704095 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.704158 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:43:05.706856 12624 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:05.711261 12624 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:05.718806 13313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.714517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:45213 (local address 127.0.0.1:60880)
0807 06:43:05.714899 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.714911 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.714963 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.715282 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.715283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.715285 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:05.715335 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.715336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.716620 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.716621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.717738 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.717740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.718452 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.718453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.718537 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.718553 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.718659 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.718715 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":36,"thread_start_us":117,"threads_started":1}
I20260807 06:43:05.718813 13315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.714636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60880 (local address 127.11.137.131:45213)
0807 06:43:05.715125 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.715129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.715149 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:43:05.715189 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.715191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.715207 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.715286 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:05.715410 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.716495 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.717827 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.718349 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.718454 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.718525 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.718677 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.718732 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":100,"threads_started":1}
I20260807 06:43:05.718992 13316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.714720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47012 (local address 127.11.137.129:42115)
0807 06:43:05.714880 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.714885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.714898 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:43:05.714941 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.714943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.714960 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.715048 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:05.715262 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.716122 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.717619 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.718372 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.718770 (+ 398us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.718826 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.718851 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.718893 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260807 06:43:05.719046 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.714427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42115 (local address 127.0.0.1:47012)
0807 06:43:05.714718 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.714762 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.714832 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.715078 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.715082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.715084 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:05.715162 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.715164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.716230 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.716231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.717523 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.717526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.718481 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.718483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.718547 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.718557 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.718601 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.718667 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":83,"threads_started":1}
I20260807 06:43:05.719497 13314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.714531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:46469 (local address 127.0.0.1:41960)
0807 06:43:05.715038 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.715047 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.715091 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.715573 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.715574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.715576 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:05.715626 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.715627 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.716816 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.716818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.717829 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.717832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.718794 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.718796 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.719310 (+ 514us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.719316 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.719390 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.719430 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":107,"threads_started":1}
I20260807 06:43:05.719769 13320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.714814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41960 (local address 127.11.137.130:46469)
0807 06:43:05.715032 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.715036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.715149 (+ 113us) server_negotiation.cc:407] Connection header received
0807 06:43:05.715222 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.715225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.715242 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.715482 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:05.715696 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.716708 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.717925 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.718614 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.718703 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.718757 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.719633 (+ 876us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.719688 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":89,"threads_started":1}
I20260807 06:43:05.719762 13202 tablet_service.cc:1467] Processing CreateTablet for tablet 71fc653a4649402cbd306c4d668d43f8 (DEFAULT_TABLE table=test-table [id=b2802f1a68994ac3bf10980777d72359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:05.720166 13202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71fc653a4649402cbd306c4d668d43f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:05.723122 13322 tablet_bootstrap.cc:492] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a: Bootstrap starting.
I20260807 06:43:05.723176 13002 tablet_service.cc:1467] Processing CreateTablet for tablet 71fc653a4649402cbd306c4d668d43f8 (DEFAULT_TABLE table=test-table [id=b2802f1a68994ac3bf10980777d72359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:05.723551 13002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71fc653a4649402cbd306c4d668d43f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:05.723858 13322 tablet_bootstrap.cc:654] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:05.724472 13322 log.cc:824] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:05.725363 13322 tablet_bootstrap.cc:492] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a: No bootstrap required, opened a new log
I20260807 06:43:05.725804 12808 tablet_service.cc:1467] Processing CreateTablet for tablet 71fc653a4649402cbd306c4d668d43f8 (DEFAULT_TABLE table=test-table [id=b2802f1a68994ac3bf10980777d72359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:05.726133 12808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71fc653a4649402cbd306c4d668d43f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:05.726320 13322 ts_tablet_manager.cc:1397] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260807 06:43:05.726337 13324 tablet_bootstrap.cc:492] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: Bootstrap starting.
I20260807 06:43:05.727008 13324 tablet_bootstrap.cc:654] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:05.727599 13324 log.cc:824] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:05.727962 13322 raft_consensus.cc:348] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.728163 13322 raft_consensus.cc:374] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:05.728210 13322 raft_consensus.cc:729] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cfbaa225a84656ae9c12b6236b291a, State: Initialized, Role: FOLLOWER
I20260807 06:43:05.728351 13322 consensus_queue.cc:260] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.728448 13324 tablet_bootstrap.cc:492] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: No bootstrap required, opened a new log
I20260807 06:43:05.728523 13324 ts_tablet_manager.cc:1397] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:05.728626 13322 ts_tablet_manager.cc:1428] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:43:05.728847 13298 heartbeater.cc:503] Master 127.11.137.190:36953 was elected leader, sending a full tablet report...
I20260807 06:43:05.729852 13327 tablet_bootstrap.cc:492] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: Bootstrap starting.
I20260807 06:43:05.730537 13327 tablet_bootstrap.cc:654] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:05.730830 13324 raft_consensus.cc:348] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.731026 13324 raft_consensus.cc:374] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:05.731060 13327 log.cc:824] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:05.731052 13324 raft_consensus.cc:729] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d355a7ed50d54be7b1f36ac9f9821eb4, State: Initialized, Role: FOLLOWER
I20260807 06:43:05.731300 13324 consensus_queue.cc:260] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.731650 13100 heartbeater.cc:503] Master 127.11.137.190:36953 was elected leader, sending a full tablet report...
I20260807 06:43:05.731935 13324 ts_tablet_manager.cc:1428] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 06:43:05.731976 13327 tablet_bootstrap.cc:492] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: No bootstrap required, opened a new log
I20260807 06:43:05.732038 13327 ts_tablet_manager.cc:1397] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:05.733887 13327 raft_consensus.cc:348] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.734038 13327 raft_consensus.cc:374] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:05.734087 13327 raft_consensus.cc:729] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19335e541774a42b94a2f1faa642b3a, State: Initialized, Role: FOLLOWER
I20260807 06:43:05.734195 13327 consensus_queue.cc:260] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.734469 13327 ts_tablet_manager.cc:1428] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 06:43:05.734511 12903 heartbeater.cc:503] Master 127.11.137.190:36953 was elected leader, sending a full tablet report...
W20260807 06:43:05.772117 13102 tablet.cc:2369] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:05.806535 13330 raft_consensus.cc:482] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:05.806721 13330 raft_consensus.cc:504] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.807293 13330 leader_election.cc:288] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d355a7ed50d54be7b1f36ac9f9821eb4 (127.11.137.130:46469), b2cfbaa225a84656ae9c12b6236b291a (127.11.137.131:45213)
I20260807 06:43:05.810763 13320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.807607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:51711 (local address 127.11.137.130:46469)
0807 06:43:05.807664 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.807666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.807679 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:43:05.807770 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.807772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.807781 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.807824 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:05.808009 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.808794 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.809934 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.810368 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.810428 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.810435 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.810627 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.810676 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:43:05.810770 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.807496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:46469 (local address 127.11.137.129:51711)
0807 06:43:05.807599 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.807612 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.807695 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.807842 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.807842 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.807844 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:05.807924 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.807926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.808884 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.808885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.809847 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.809850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.810453 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.810454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.810550 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.810554 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.810637 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.810683 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 06:43:05.810878 13315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.807565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:41309 (local address 127.11.137.131:45213)
0807 06:43:05.807641 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.807643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.807944 (+ 301us) server_negotiation.cc:407] Connection header received
0807 06:43:05.808000 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.808001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.808011 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.808067 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:05.808222 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.808907 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.810031 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.810436 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.810513 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.810523 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.810748 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.810809 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:43:05.811326 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.807496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:45213 (local address 127.11.137.129:41309)
0807 06:43:05.807843 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:05.807870 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:05.807943 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:05.808081 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:05.808082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:05.808083 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:05.808144 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.808145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.808990 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.808991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.809940 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:05.809942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.810529 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.810530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:05.810611 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.810616 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:05.810734 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 06:43:05.810775 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":144,"thread_start_us":137,"threads_started":1}
I20260807 06:43:05.811249 13036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71fc653a4649402cbd306c4d668d43f8" candidate_uuid: "b19335e541774a42b94a2f1faa642b3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" is_pre_election: true
I20260807 06:43:05.811475 13036 raft_consensus.cc:2454] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19335e541774a42b94a2f1faa642b3a in term 0.
I20260807 06:43:05.811784 13231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71fc653a4649402cbd306c4d668d43f8" candidate_uuid: "b19335e541774a42b94a2f1faa642b3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cfbaa225a84656ae9c12b6236b291a" is_pre_election: true
I20260807 06:43:05.811837 12743 leader_election.cc:302] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b19335e541774a42b94a2f1faa642b3a, d355a7ed50d54be7b1f36ac9f9821eb4; no voters:
I20260807 06:43:05.811967 13231 raft_consensus.cc:2454] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19335e541774a42b94a2f1faa642b3a in term 0.
I20260807 06:43:05.811990 13330 raft_consensus.cc:2781] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:05.812057 13330 raft_consensus.cc:482] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:05.812083 13330 raft_consensus.cc:3037] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:05.812824 13330 raft_consensus.cc:504] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.812976 13330 leader_election.cc:288] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [CANDIDATE]: Term 1 election: Requested vote from peers d355a7ed50d54be7b1f36ac9f9821eb4 (127.11.137.130:46469), b2cfbaa225a84656ae9c12b6236b291a (127.11.137.131:45213)
I20260807 06:43:05.813184 13231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71fc653a4649402cbd306c4d668d43f8" candidate_uuid: "b19335e541774a42b94a2f1faa642b3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cfbaa225a84656ae9c12b6236b291a"
I20260807 06:43:05.813184 13036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71fc653a4649402cbd306c4d668d43f8" candidate_uuid: "b19335e541774a42b94a2f1faa642b3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4"
I20260807 06:43:05.813292 13231 raft_consensus.cc:3037] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:05.813292 13036 raft_consensus.cc:3037] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:05.814208 13036 raft_consensus.cc:2454] T 71fc653a4649402cbd306c4d668d43f8 P d355a7ed50d54be7b1f36ac9f9821eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19335e541774a42b94a2f1faa642b3a in term 1.
I20260807 06:43:05.814208 13231 raft_consensus.cc:2454] T 71fc653a4649402cbd306c4d668d43f8 P b2cfbaa225a84656ae9c12b6236b291a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19335e541774a42b94a2f1faa642b3a in term 1.
I20260807 06:43:05.814417 12741 leader_election.cc:302] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b19335e541774a42b94a2f1faa642b3a, b2cfbaa225a84656ae9c12b6236b291a; no voters:
I20260807 06:43:05.814544 13330 raft_consensus.cc:2781] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:05.814700 13330 raft_consensus.cc:686] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [term 1 LEADER]: Becoming Leader. State: Replica: b19335e541774a42b94a2f1faa642b3a, State: Running, Role: LEADER
I20260807 06:43:05.814808 13330 consensus_queue.cc:237] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } }
I20260807 06:43:05.815809 12624 catalog_manager.cc:5495] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a reported cstate change: term changed from 0 to 1, leader changed from <none> to b19335e541774a42b94a2f1faa642b3a (127.11.137.129). New cstate: current_term: 1 leader_uuid: "b19335e541774a42b94a2f1faa642b3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19335e541774a42b94a2f1faa642b3a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d355a7ed50d54be7b1f36ac9f9821eb4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cfbaa225a84656ae9c12b6236b291a" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45213 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:05.849268 13316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.838464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47026 (local address 127.11.137.129:42115)
0807 06:43:05.838509 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.838511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.838519 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:05.838547 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.838548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.838558 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.838617 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.841147 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.842122 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.843187 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.843425 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.843532 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.846153 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.846166 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.846167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.846176 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.847800 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.848277 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.848280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.848281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.848357 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.848594 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.848595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.848595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.848774 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.848940 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.849033 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.849125 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260807 06:43:05.849965 12904 tablet.cc:2369] T 71fc653a4649402cbd306c4d668d43f8 P b19335e541774a42b94a2f1faa642b3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:05.874214 13316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.866862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47030 (local address 127.11.137.129:42115)
0807 06:43:05.866953 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.866955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.867040 (+ 85us) server_negotiation.cc:407] Connection header received
0807 06:43:05.867148 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.867150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.867161 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.867242 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.867833 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.868376 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.869147 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.869458 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.869542 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.871753 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.871755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.871755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.871762 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.873141 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.873516 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.873517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.873517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.873570 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.873749 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.873749 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.873749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.873840 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.873914 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.874067 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.874135 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:43:05 dist-test-slave-8hhm krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:05.899237 13316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:05.891270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47036 (local address 127.11.137.129:42115)
0807 06:43:05.891343 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:05.891345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:05.891435 (+ 90us) server_negotiation.cc:407] Connection header received
0807 06:43:05.891507 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:05.891508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:05.891521 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:05.891575 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:05.892458 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.893110 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.894236 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:05.894427 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:05.894487 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:05.896710 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:05.896712 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:05.896712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:05.896721 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:05.898107 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.898468 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.898469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.898470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.898520 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:05.898728 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:05.898729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:05.898730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:05.898830 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:05.898932 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:05.899039 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 06:43:05.899131 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 06:43:05.900053 12779 tablet_service.cc:2908] Rejecting scan request for tablet 71fc653a4649402cbd306c4d668d43f8: Uninitialized: clean time has not yet been initialized
I20260807 06:43:05.901253 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12716
I20260807 06:43:05.914001 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12909
I20260807 06:43:05.930768 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13107
I20260807 06:43:05.942153 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12578
2026-08-07T06:43:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2323 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:06 dist-test-slave-8hhm krb5kdc[13358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:06 dist-test-slave-8hhm krb5kdc[13358](info): set up 2 sockets
Aug 07 06:43:06 dist-test-slave-8hhm krb5kdc[13358](info): commencing operation
krb5kdc: starting...
W20260807 06:43:07.222906 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:07.344389 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42355
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:42355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:07.426877 13376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:07.427137 13376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:07.427177 13376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:07.428344 13376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:07.428416 13376 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:43:07.428438 13376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:07.428460 13376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:07.428501 13376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:07.428532 13376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:07.430122 13376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:42355
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:07.430406 13376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:07.430645 13376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:07.435518 13387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.435590 13376 server_base.cc:1034] running on GCE node
W20260807 06:43:07.435580 13381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:07.435523 13382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.436018 13376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:07.436316 13376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:07.437479 13376 hybrid_clock.cc:648] HybridClock initialized: now 1786084987437471 us; error 37 us; skew 500 ppm
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:07.440095 13376 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:07.440557 13376 webserver.cc:460] Webserver started at http://127.11.137.190:35937/ using document root <none> and password file <none>
I20260807 06:43:07.440759 13376 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:07.440800 13376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:07.440888 13376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:07.441939 13376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "cb0bfec6cf764ba4aad711fbecb3a24c"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "05e969fe90152f6c3b77326f33b296e8"
server_key_iv: "cfeb509579f08fd335bf5afebb0ec656"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.442253 13376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "cb0bfec6cf764ba4aad711fbecb3a24c"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "05e969fe90152f6c3b77326f33b296e8"
server_key_iv: "cfeb509579f08fd335bf5afebb0ec656"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.443516 13376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:07.444208 13400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.444383 13376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:07.444496 13376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "cb0bfec6cf764ba4aad711fbecb3a24c"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "05e969fe90152f6c3b77326f33b296e8"
server_key_iv: "cfeb509579f08fd335bf5afebb0ec656"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.444590 13376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:07.467455 13376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:07.469866 13376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:07.470033 13376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:07.475281 13376 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:42355
I20260807 06:43:07.475349 13489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:42355 every 8 connection(s)
I20260807 06:43:07.475668 13376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:07.476296 13491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:07.478940 13491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: Bootstrap starting.
I20260807 06:43:07.479544 13491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:07.479583 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13376
I20260807 06:43:07.479681 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:07.479869 11814 external_mini_cluster.cc:1428] Setting key 2fc343d4ba3f0546115d18451998bcc2
I20260807 06:43:07.479912 13491 log.cc:824] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:07.480844 13491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: No bootstrap required, opened a new log
I20260807 06:43:07.482877 13491 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42355 } }
I20260807 06:43:07.483049 13491 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:07.483086 13491 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0bfec6cf764ba4aad711fbecb3a24c, State: Initialized, Role: FOLLOWER
I20260807 06:43:07.483217 13491 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42355 } }
I20260807 06:43:07.483299 13491 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:07.483325 13491 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:07.483366 13491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:07.484050 13491 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42355 } }
I20260807 06:43:07.484187 13491 leader_election.cc:302] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb0bfec6cf764ba4aad711fbecb3a24c; no voters:
I20260807 06:43:07.484375 13491 leader_election.cc:288] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:07.484397 13497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:07.484503 13497 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [term 1 LEADER]: Becoming Leader. State: Replica: cb0bfec6cf764ba4aad711fbecb3a24c, State: Running, Role: LEADER
I20260807 06:43:07.484586 13497 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42355 } }
I20260807 06:43:07.484629 13491 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:07.484905 13497 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42355 } } }
I20260807 06:43:07.484977 13497 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:07.485102 13497 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb0bfec6cf764ba4aad711fbecb3a24c. Latest consensus state: current_term: 1 leader_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0bfec6cf764ba4aad711fbecb3a24c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42355 } } }
I20260807 06:43:07.485170 13497 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c [sys.catalog]: This master's current role is: LEADER
W20260807 06:43:07.486513 13522 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:43:07.486570 13522 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:43:07.486616 13505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:07.486801 13505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:07.489604 13505 catalog_manager.cc:1347] Generated new cluster ID: 090b722cabd34791b36edbb2144f16fb
I20260807 06:43:07.489660 13505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:07.492558 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.480376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48812 (local address 127.11.137.190:42355)
0807 06:43:07.480549 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.480558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.480592 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:43:07.481163 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.481173 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.481260 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.481416 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.481992 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.483974 (+ 1982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.485217 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.485856 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.485934 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.488812 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.488815 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.488815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.488825 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.490654 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.491016 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.491019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.491019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.491115 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.491329 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.491330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.491331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.491578 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:07.492257 (+ 679us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:07.492323 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 06:43:07.492421 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260807 06:43:07.507493 13505 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:07.507980 13505 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:07.518318 13505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: Generated new TSK 0
I20260807 06:43:07.518512 13505 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:07.552559 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42355
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:07.634845 13530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:07.635056 13530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:07.635097 13530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:07.636257 13530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:07.636322 13530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:07.636354 13530 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:07.636404 13530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:07.637926 13530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:42355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:07.638185 13530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:07.638415 13530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:07.643405 13538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:07.643430 13537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.643572 13530 server_base.cc:1034] running on GCE node
W20260807 06:43:07.643419 13542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.643924 13530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:07.644210 13530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:07.645351 13530 hybrid_clock.cc:648] HybridClock initialized: now 1786084987645342 us; error 29 us; skew 500 ppm
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:07.647907 13530 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:07.648391 13530 webserver.cc:460] Webserver started at http://127.11.137.129:33443/ using document root <none> and password file <none>
I20260807 06:43:07.648639 13530 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:07.648693 13530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:07.648787 13530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:07.649900 13530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "66ef080ec84140a989cdcf3b92db4756"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "94fbb454943d084a392551632fa98bbf"
server_key_iv: "67b01e69db86e163a9c0bb783d682eca"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.650264 13530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "66ef080ec84140a989cdcf3b92db4756"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "94fbb454943d084a392551632fa98bbf"
server_key_iv: "67b01e69db86e163a9c0bb783d682eca"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.651594 13530 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:07.652344 13556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.652563 13530 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:07.652654 13530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "66ef080ec84140a989cdcf3b92db4756"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "94fbb454943d084a392551632fa98bbf"
server_key_iv: "67b01e69db86e163a9c0bb783d682eca"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.652737 13530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:07.662556 13530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:07.664361 13530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:07.664558 13530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:07.665125 13530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:07.665283 13530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.665331 13530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:07.665345 13530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:07.674244 13530 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:44465
I20260807 06:43:07.674329 13717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:44465 every 8 connection(s)
I20260807 06:43:07.674715 13530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:07.677469 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.665739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:44423 (local address 127.11.137.190:42355)
0807 06:43:07.665814 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.665816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.666050 (+ 234us) server_negotiation.cc:407] Connection header received
0807 06:43:07.666812 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.666813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.666825 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.666879 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.667822 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.668648 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.670292 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.670542 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.670652 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.674257 (+ 3605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.674259 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.674260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.674269 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.675875 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.676338 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.676339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.676340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.676414 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.676719 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.676720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.676721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.676866 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:07.676953 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:07.677263 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 06:43:07.677362 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:43:07.677645 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.665705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.11.137.129:44423)
0807 06:43:07.665888 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:07.665938 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:07.666676 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:07.666964 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:07.666969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:07.667394 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:07.667695 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.667702 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.668760 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.668761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.670165 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.670181 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.670657 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.670659 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.670834 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.671406 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:07.671417 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:07.674134 (+ 2717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:07.675978 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.675987 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.675988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.676233 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.676509 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.676510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.676511 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.676629 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.676943 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:07.676951 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:07.677098 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 06:43:07.677217 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 06:43:07.677399 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":98,"threads_started":1}
I20260807 06:43:07.678179 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13530
I20260807 06:43:07.678296 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:07.678465 11814 external_mini_cluster.cc:1428] Setting key bed19e7ebe172260130f7b490583a195
I20260807 06:43:07.678830 13718 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42355
I20260807 06:43:07.678988 13718 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:07.679226 13718 heartbeater.cc:511] Master 127.11.137.190:42355 requested a full tablet report, sending...
I20260807 06:43:07.679809 13423 ts_manager.cc:194] Registered new tserver with Master: 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465)
I20260807 06:43:07.680624 13423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:44423
I20260807 06:43:07.686357 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.679634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.11.137.129:43407)
0807 06:43:07.679787 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:07.679798 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:07.679862 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:07.680004 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:07.680005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:07.680228 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:07.680286 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.680288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.681668 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.681669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.682147 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.682148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.682496 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.682497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.682589 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.682988 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:07.682993 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:07.683423 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:07.685067 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.685068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.685069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.685355 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.685616 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.685617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.685617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.685681 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.686013 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:07.686014 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:07.686052 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:43:07.686106 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 06:43:07.686239 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260807 06:43:07.686359 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.679660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:43407 (local address 127.11.137.190:42355)
0807 06:43:07.679693 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.679695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.679876 (+ 181us) server_negotiation.cc:407] Connection header received
0807 06:43:07.679908 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.679909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.679923 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.680000 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.680368 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.681098 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.682226 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.682402 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.682454 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.683512 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.683513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.683513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.683519 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.684976 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.685445 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.685445 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.685445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.685499 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.685755 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.685756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.685756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.685920 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:07.686034 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:07.686143 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 06:43:07.686228 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:07.707667 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42355
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:07.789992 13729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:07.790189 13729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:07.790211 13729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:07.791358 13729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:07.791399 13729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:07.791419 13729 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:07.791436 13729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:07.792862 13729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:42355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:07.793097 13729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:07.793372 13729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:07.798192 13744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:07.798205 13742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:07.798236 13746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.798455 13729 server_base.cc:1034] running on GCE node
I20260807 06:43:07.798693 13729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:07.798920 13729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:07.800076 13729 hybrid_clock.cc:648] HybridClock initialized: now 1786084987800045 us; error 44 us; skew 500 ppm
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:07.802817 13729 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:07.803298 13729 webserver.cc:460] Webserver started at http://127.11.137.130:41611/ using document root <none> and password file <none>
I20260807 06:43:07.803537 13729 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:07.803586 13729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:07.803750 13729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:07.804869 13729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "2d909d19e7154799897cfc01446b03dc"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "c8314d3b313229cda9b2141d7856fb25"
server_key_iv: "d35255c76617c65e08f82a00203030fc"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.805330 13729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "2d909d19e7154799897cfc01446b03dc"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "c8314d3b313229cda9b2141d7856fb25"
server_key_iv: "d35255c76617c65e08f82a00203030fc"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.806829 13729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:07.807636 13756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.807848 13729 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:07.807952 13729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "2d909d19e7154799897cfc01446b03dc"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "c8314d3b313229cda9b2141d7856fb25"
server_key_iv: "d35255c76617c65e08f82a00203030fc"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.808037 13729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:07.829880 13729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:07.832154 13729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:07.832310 13729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:07.832959 13729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:07.833004 13729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.833030 13729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:07.833070 13729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:07.841318 13729 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:32989
I20260807 06:43:07.841400 13919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:32989 every 8 connection(s)
I20260807 06:43:07.841802 13729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:07.842875 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13729
I20260807 06:43:07.842994 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:07.843186 11814 external_mini_cluster.cc:1428] Setting key e21b67111b1803e783983e37527cd10f
I20260807 06:43:07.844045 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.833496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:53251 (local address 127.11.137.190:42355)
0807 06:43:07.833576 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.833580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.833751 (+ 171us) server_negotiation.cc:407] Connection header received
0807 06:43:07.834246 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.834248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.834264 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.834343 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.834957 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.835900 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.837449 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.837837 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.837927 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.840783 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.840784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.840785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.840792 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.842492 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.842948 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.842949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.842949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.843013 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.843284 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.843285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.843286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.843419 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:07.843506 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:07.843872 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 06:43:07.843951 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:43:07.844237 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.833424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.11.137.130:53251)
0807 06:43:07.833612 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:07.833653 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:07.834139 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:07.834425 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:07.834428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:07.834671 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:07.834850 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.834855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.836009 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.836010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.837378 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.837381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.837955 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.837956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.838077 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.838643 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:07.838655 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:07.840679 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:07.842577 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.842583 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.842585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.842866 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.843100 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.843101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.843101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.843211 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.843584 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:07.843591 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:07.843740 (+ 149us) client_negotiation.cc:769] Sending connection context
0807 06:43:07.843850 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:43:07.844009 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260807 06:43:07.845571 13920 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42355
I20260807 06:43:07.845657 13920 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:07.845894 13920 heartbeater.cc:511] Master 127.11.137.190:42355 requested a full tablet report, sending...
I20260807 06:43:07.846314 13425 ts_manager.cc:194] Registered new tserver with Master: 2d909d19e7154799897cfc01446b03dc (127.11.137.130:32989)
I20260807 06:43:07.846912 13425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:53251
I20260807 06:43:07.853935 13928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.847189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.11.137.130:41557)
0807 06:43:07.847357 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:07.847369 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:07.847426 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:07.847550 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:07.847551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:07.847806 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:07.847871 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.847873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.849004 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.849005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.849593 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.849595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.850138 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.850139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.850193 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.850674 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:07.850678 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:07.850934 (+ 256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:07.852800 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.852801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.852801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.852967 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.853192 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.853192 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.853192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.853299 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.853680 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:07.853681 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:07.853717 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 06:43:07.853779 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 06:43:07.853850 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260807 06:43:07.854053 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.847242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:41557 (local address 127.11.137.190:42355)
0807 06:43:07.847278 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.847280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.847410 (+ 130us) server_negotiation.cc:407] Connection header received
0807 06:43:07.847482 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.847483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.847492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.847535 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.847987 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.848871 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.849678 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.850051 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.850142 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.851029 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.851030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.851031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.851039 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.852720 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.853048 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.853049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.853050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.853118 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.853354 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.853355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.853356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.853587 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:07.853690 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:07.853818 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 06:43:07.853934 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:07.871197 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42355
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:07.954274 13930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:07.954464 13930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:07.954488 13930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:07.955680 13930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:07.955739 13930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:07.955770 13930 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:07.955809 13930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:07.957275 13930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:42355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:07.957522 13930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:07.957762 13930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:07.962721 13941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:07.962728 13939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.962743 13930 server_base.cc:1034] running on GCE node
W20260807 06:43:07.962728 13936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:07.963279 13930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:07.963486 13930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:07.964636 13930 hybrid_clock.cc:648] HybridClock initialized: now 1786084987964625 us; error 26 us; skew 500 ppm
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:07.967272 13930 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:07.967706 13930 webserver.cc:460] Webserver started at http://127.11.137.131:41581/ using document root <none> and password file <none>
I20260807 06:43:07.967921 13930 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:07.967964 13930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:07.968104 13930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:07.969147 13930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "a7ddc31b1e5c49aab24a882b11f9c613"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "5d03130356f954ee934fa0ea2b3f04a4"
server_key_iv: "fb75da18538caeeb0e68ccce9f99c9de"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.969579 13930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "a7ddc31b1e5c49aab24a882b11f9c613"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "5d03130356f954ee934fa0ea2b3f04a4"
server_key_iv: "fb75da18538caeeb0e68ccce9f99c9de"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.970968 13930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:07.971760 13950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.971961 13930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:07.972059 13930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "a7ddc31b1e5c49aab24a882b11f9c613"
format_stamp: "Formatted at 2026-08-07 06:43:07 on dist-test-slave-8hhm"
server_key: "5d03130356f954ee934fa0ea2b3f04a4"
server_key_iv: "fb75da18538caeeb0e68ccce9f99c9de"
server_key_version: "encryptionkey@0"
I20260807 06:43:07.972134 13930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:07.980415 13930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:07.982266 13930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:07.982421 13930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:07.982887 13930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:07.982950 13930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:07.982992 13930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:07.983039 13930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:07 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:07.989813 13930 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:34473
I20260807 06:43:07.989887 14115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:34473 every 8 connection(s)
I20260807 06:43:07.990155 13930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:07.993412 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.983358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:47563 (local address 127.11.137.190:42355)
0807 06:43:07.983423 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.983425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.983616 (+ 191us) server_negotiation.cc:407] Connection header received
0807 06:43:07.984054 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.984055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.984068 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.984144 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.984943 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.985755 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.987227 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.987542 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.987629 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.990281 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.990282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.990283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.990291 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.991695 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.992414 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.992415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.992415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.992467 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:07.992748 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:07.992749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:07.992749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:07.992867 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:07.992944 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:07.993243 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 06:43:07.993323 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 06:43:07.993597 13963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.983340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.11.137.131:47563)
0807 06:43:07.983481 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:07.983517 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:07.983952 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:07.984213 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:07.984216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:07.984594 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:07.984860 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.984866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.985862 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.985863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.987132 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.987136 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.987647 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.987647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.987767 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.988295 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:07.988304 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:07.990186 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:07.991831 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.991839 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.991841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.992063 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.992549 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.992550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.992550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:07.992671 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:07.992936 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:07.992942 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:07.993082 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 06:43:07.993186 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 06:43:07.993364 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":81,"threads_started":1}
I20260807 06:43:07.994066 14117 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42355
I20260807 06:43:07.994150 14117 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:07.994333 14117 heartbeater.cc:511] Master 127.11.137.190:42355 requested a full tablet report, sending...
I20260807 06:43:07.994736 13423 ts_manager.cc:194] Registered new tserver with Master: a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:07.995206 13423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:47563
I20260807 06:43:07.995625 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13930
I20260807 06:43:07.995716 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:07.995883 11814 external_mini_cluster.cc:1428] Setting key 772939297cd37ec4b9658ac001152e8e
I20260807 06:43:07.996708 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:08.000931 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.995162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:60013 (local address 127.11.137.190:42355)
0807 06:43:07.995201 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:07.995203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:07.995311 (+ 108us) server_negotiation.cc:407] Connection header received
0807 06:43:07.995368 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:07.995369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:07.995380 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:07.995449 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:07.995782 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.996420 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.997241 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.997443 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.997515 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.998326 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:07.998327 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:07.998327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:07.998334 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:07.999819 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.000229 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.000230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.000231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.000292 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.000501 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.000502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.000502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.000593 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:08.000643 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.000817 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.000874 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:08.001046 14124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:07.995093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.11.137.131:60013)
0807 06:43:07.995217 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:07.995227 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:07.995307 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:07.995463 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:07.995464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:07.995617 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:07.995663 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.995665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.996513 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.996514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.997117 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:07.997119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:07.997515 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:07.997516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:07.997590 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:07.997983 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:07.997987 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:07.998239 (+ 252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:07.999899 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:07.999900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:07.999900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:08.000133 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:08.000360 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:08.000361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:08.000362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:08.000439 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:08.000659 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:08.000660 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:08.000710 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.000783 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.000895 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[13358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084988, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084988, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:08.021014 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.014693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48828 (local address 127.11.137.190:42355)
0807 06:43:08.014750 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.014752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.014768 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:43:08.014789 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.014789 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.014797 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.014845 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:08.015376 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.015839 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.016513 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.016692 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.016739 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.018943 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:08.018944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:08.018944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:08.018950 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:08.020122 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.020422 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.020423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.020423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.020472 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.020632 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.020633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.020633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.020724 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:08.020796 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.020900 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.020955 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:08.022570 13423 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:08.024089 13423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:08.030431 14144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.026330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:34473 (local address 127.0.0.1:40558)
0807 06:43:08.026620 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.026630 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.026683 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.026945 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.026950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.026952 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.027016 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.027017 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.028056 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.028057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.029333 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.029336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.030135 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.030136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.030225 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.030240 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.030306 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.030358 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":77,"threads_started":1}
I20260807 06:43:08.030565 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.026434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34356 (local address 127.11.137.129:44465)
0807 06:43:08.026761 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.026766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.026776 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:08.026811 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.026813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.026827 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.026927 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.027168 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.028251 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.029479 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.030171 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.030266 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.030318 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.030398 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.030440 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":85,"threads_started":1}
I20260807 06:43:08.030691 14146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.026433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.11.137.131:34473)
0807 06:43:08.026632 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.026637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.026675 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:43:08.026787 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.026790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.026806 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.026878 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.027110 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.027968 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.029407 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.030030 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.030133 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.030191 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.030560 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.030608 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":79,"threads_started":1}
I20260807 06:43:08.030764 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.026324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44465 (local address 127.0.0.1:34356)
0807 06:43:08.026494 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.026539 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.026605 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.026943 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.026946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.026949 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.027016 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.027020 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.028341 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.028342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.029416 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.029418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.030265 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.030265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.030324 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.030326 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.030382 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.030414 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":4,"thread_start_us":50,"threads_started":1}
I20260807 06:43:08.030864 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.026531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:32989 (local address 127.0.0.1:42466)
0807 06:43:08.027134 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.027144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.027200 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.027461 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.027461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.027463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.027499 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.027501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.028632 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.028633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.029663 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.029665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.030623 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.030624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.030710 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.030715 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.030759 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.030796 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":1,"thread_start_us":85,"threads_started":1}
I20260807 06:43:08.031222 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.026748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.11.137.130:32989)
0807 06:43:08.026905 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.026909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.027261 (+ 352us) server_negotiation.cc:407] Connection header received
0807 06:43:08.027306 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.027308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.027323 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.027392 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.027588 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.028552 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.029753 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.030443 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.030998 (+ 555us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.031060 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.031085 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.031124 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260807 06:43:08.031487 13618 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2c38144d56447cbdae3483c10089ce (DEFAULT_TABLE table=test-table [id=566551d204284d14b888bd343082a6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:08.031494 14008 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2c38144d56447cbdae3483c10089ce (DEFAULT_TABLE table=test-table [id=566551d204284d14b888bd343082a6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:08.031903 14008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2c38144d56447cbdae3483c10089ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.031912 13618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2c38144d56447cbdae3483c10089ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.031876 13820 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2c38144d56447cbdae3483c10089ce (DEFAULT_TABLE table=test-table [id=566551d204284d14b888bd343082a6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:08.032205 13820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2c38144d56447cbdae3483c10089ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.034778 14150 tablet_bootstrap.cc:492] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Bootstrap starting.
I20260807 06:43:08.035418 14153 tablet_bootstrap.cc:492] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Bootstrap starting.
I20260807 06:43:08.035482 14150 tablet_bootstrap.cc:654] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.036121 14150 log.cc:824] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:08.036527 14153 tablet_bootstrap.cc:654] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.036494 14154 tablet_bootstrap.cc:492] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Bootstrap starting.
I20260807 06:43:08.036854 14150 tablet_bootstrap.cc:492] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: No bootstrap required, opened a new log
I20260807 06:43:08.036918 14153 log.cc:824] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:08.036942 14150 ts_tablet_manager.cc:1397] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:08.037158 14154 tablet_bootstrap.cc:654] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.037549 14154 log.cc:824] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:08.037722 14153 tablet_bootstrap.cc:492] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: No bootstrap required, opened a new log
I20260807 06:43:08.037801 14153 ts_tablet_manager.cc:1397] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:08.038368 14154 tablet_bootstrap.cc:492] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: No bootstrap required, opened a new log
I20260807 06:43:08.038434 14154 ts_tablet_manager.cc:1397] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:08.039069 14150 raft_consensus.cc:348] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.039240 14150 raft_consensus.cc:374] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.039278 14150 raft_consensus.cc:729] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ef080ec84140a989cdcf3b92db4756, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.039388 14150 consensus_queue.cc:260] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.039544 14153 raft_consensus.cc:348] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.039669 14150 ts_tablet_manager.cc:1428] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:08.039711 13718 heartbeater.cc:503] Master 127.11.137.190:42355 was elected leader, sending a full tablet report...
I20260807 06:43:08.039762 14153 raft_consensus.cc:374] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.039844 14153 raft_consensus.cc:729] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ddc31b1e5c49aab24a882b11f9c613, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.040066 14153 consensus_queue.cc:260] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.040374 14153 ts_tablet_manager.cc:1428] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:08.040412 14117 heartbeater.cc:503] Master 127.11.137.190:42355 was elected leader, sending a full tablet report...
I20260807 06:43:08.040426 14154 raft_consensus.cc:348] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.040575 14154 raft_consensus.cc:374] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.040609 14154 raft_consensus.cc:729] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d909d19e7154799897cfc01446b03dc, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.040702 14154 consensus_queue.cc:260] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.041000 14154 ts_tablet_manager.cc:1428] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:08.041136 13920 heartbeater.cc:503] Master 127.11.137.190:42355 was elected leader, sending a full tablet report...
I20260807 06:43:08.060395 14163 raft_consensus.cc:482] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:08.060494 14163 raft_consensus.cc:504] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.060811 14163 leader_election.cc:288] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465), a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:08.063613 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.061019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:38045 (local address 127.11.137.129:44465)
0807 06:43:08.061069 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.061071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.061081 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:08.061167 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.061168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.061186 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.061322 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.061487 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.061973 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.062904 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.063259 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.063347 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.063355 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.063507 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.063545 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 06:43:08.063613 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.060963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44465 (local address 127.11.137.130:38045)
0807 06:43:08.061022 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.061033 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.061097 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.061335 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.061336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.061338 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.061413 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.061415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.062063 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.062064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.062804 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.062806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.063347 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.063348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.063430 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.063433 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.063500 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.063538 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 06:43:08.063689 14146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.061071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:58851 (local address 127.11.137.131:34473)
0807 06:43:08.061111 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.061113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.061238 (+ 125us) server_negotiation.cc:407] Connection header received
0807 06:43:08.061341 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.061343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.061353 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.061429 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.061589 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.062033 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.062946 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.063322 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.063407 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.063415 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.063563 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.063596 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:08.063835 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.060986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:34473 (local address 127.11.137.130:58851)
0807 06:43:08.061153 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.061163 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.061262 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.061435 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.061436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.061438 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.061515 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.061516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.062122 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.062123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.062854 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.062856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.063409 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.063410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.063489 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.063492 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.063558 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.063596 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260807 06:43:08.063964 13646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2c38144d56447cbdae3483c10089ce" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ef080ec84140a989cdcf3b92db4756" is_pre_election: true
I20260807 06:43:08.064128 13646 raft_consensus.cc:2454] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 0.
I20260807 06:43:08.064145 14048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2c38144d56447cbdae3483c10089ce" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" is_pre_election: true
I20260807 06:43:08.064303 14048 raft_consensus.cc:2454] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 0.
I20260807 06:43:08.064373 13762 leader_election.cc:302] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d909d19e7154799897cfc01446b03dc, 66ef080ec84140a989cdcf3b92db4756; no voters:
I20260807 06:43:08.064518 14163 raft_consensus.cc:2781] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:08.064584 14163 raft_consensus.cc:482] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:08.064607 14163 raft_consensus.cc:3037] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.065387 14163 raft_consensus.cc:504] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.065655 14163 leader_election.cc:288] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 election: Requested vote from peers 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465), a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:08.065733 14048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2c38144d56447cbdae3483c10089ce" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ddc31b1e5c49aab24a882b11f9c613"
I20260807 06:43:08.065824 14048 raft_consensus.cc:3037] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.065971 13646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2c38144d56447cbdae3483c10089ce" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ef080ec84140a989cdcf3b92db4756"
I20260807 06:43:08.066031 13646 raft_consensus.cc:3037] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.066522 14048 raft_consensus.cc:2454] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 1.
I20260807 06:43:08.066666 13646 raft_consensus.cc:2454] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 1.
I20260807 06:43:08.067240 13760 leader_election.cc:302] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d909d19e7154799897cfc01446b03dc, a7ddc31b1e5c49aab24a882b11f9c613; no voters:
I20260807 06:43:08.067397 14163 raft_consensus.cc:2781] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:08.067553 14163 raft_consensus.cc:686] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 1 LEADER]: Becoming Leader. State: Replica: 2d909d19e7154799897cfc01446b03dc, State: Running, Role: LEADER
I20260807 06:43:08.067667 14163 consensus_queue.cc:237] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } }
I20260807 06:43:08.068457 13423 catalog_manager.cc:5495] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d909d19e7154799897cfc01446b03dc (127.11.137.130). New cstate: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:08.083343 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.081107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42470 (local address 127.11.137.130:32989)
0807 06:43:08.081149 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.081151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.081160 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:08.081305 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.081305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.081320 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.081391 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:08.081518 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.081938 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.082666 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.082838 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.082886 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.083062 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.083148 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.083205 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.083252 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.083268 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:08.085134 14048 raft_consensus.cc:1261] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Refusing update from remote peer 2d909d19e7154799897cfc01446b03dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:08.085491 14163 consensus_queue.cc:1035] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:08.087085 13646 raft_consensus.cc:1261] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Refusing update from remote peer 2d909d19e7154799897cfc01446b03dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:08.087460 14165 consensus_queue.cc:1035] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:08.089274 14172 mvcc.cc:205] Tried to move back new op lower bound from 7315804111193645056 to 7315804111125712896. Current Snapshot: MvccSnapshot[applied={T|T < 7315804111193645056}]
I20260807 06:43:08.092099 13423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:08.092236 13423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:08.093098 13423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: Sending DeleteTablet for 3 replicas of tablet 9b2c38144d56447cbdae3483c10089ce
I20260807 06:43:08.093578 13618 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2c38144d56447cbdae3483c10089ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:08 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:34356
I20260807 06:43:08.093592 13820 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2c38144d56447cbdae3483c10089ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:08 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:42466
I20260807 06:43:08.093801 14008 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2c38144d56447cbdae3483c10089ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:08 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:40558
I20260807 06:43:08.093855 13423 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:08.094005 13423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:08.094007 14186 tablet_replica.cc:330] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: stopping tablet replica
I20260807 06:43:08.094116 14186 raft_consensus.cc:2229] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:08.094220 14186 raft_consensus.cc:2258] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:08.094380 14187 tablet_replica.cc:330] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: stopping tablet replica
I20260807 06:43:08.094470 14187 raft_consensus.cc:2229] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:08.094558 14187 raft_consensus.cc:2258] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:08.095052 14187 ts_tablet_manager.cc:1905] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:08.095244 13820 tablet_service.cc:1467] Processing CreateTablet for tablet 639c4afe4cbc4c738d10c6d066d5bc28 (DEFAULT_TABLE table=test-table [id=010ce468e4e444bf813646e57bb85fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:08.095284 13618 tablet_service.cc:1467] Processing CreateTablet for tablet 639c4afe4cbc4c738d10c6d066d5bc28 (DEFAULT_TABLE table=test-table [id=010ce468e4e444bf813646e57bb85fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:08.095368 13820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639c4afe4cbc4c738d10c6d066d5bc28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.095371 13618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639c4afe4cbc4c738d10c6d066d5bc28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.096869 14187 ts_tablet_manager.cc:1918] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:08.096904 14188 tablet_replica.cc:330] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: stopping tablet replica
I20260807 06:43:08.097028 14187 log.cc:1196] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/9b2c38144d56447cbdae3483c10089ce
I20260807 06:43:08.097052 14188 raft_consensus.cc:2229] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:08.097066 14008 tablet_service.cc:1467] Processing CreateTablet for tablet 639c4afe4cbc4c738d10c6d066d5bc28 (DEFAULT_TABLE table=test-table [id=010ce468e4e444bf813646e57bb85fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:08.097162 14188 raft_consensus.cc:2258] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:08.097285 14150 tablet_bootstrap.cc:492] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Bootstrap starting.
I20260807 06:43:08.097908 14150 tablet_bootstrap.cc:654] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.097218 14154 tablet_bootstrap.cc:492] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Bootstrap starting.
I20260807 06:43:08.098515 14150 tablet_bootstrap.cc:492] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: No bootstrap required, opened a new log
I20260807 06:43:08.098562 14150 ts_tablet_manager.cc:1397] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:08.098713 14150 raft_consensus.cc:348] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.098767 14154 tablet_bootstrap.cc:654] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.098770 14150 raft_consensus.cc:374] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.098793 14150 raft_consensus.cc:729] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ef080ec84140a989cdcf3b92db4756, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.098843 14150 consensus_queue.cc:260] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.098932 14150 ts_tablet_manager.cc:1428] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:08.097605 14187 ts_tablet_manager.cc:1939] T 9b2c38144d56447cbdae3483c10089ce P 2d909d19e7154799897cfc01446b03dc: Deleting consensus metadata
I20260807 06:43:08.097172 14008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639c4afe4cbc4c738d10c6d066d5bc28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.099645 13405 catalog_manager.cc:4841] TS 2d909d19e7154799897cfc01446b03dc (127.11.137.130:32989): tablet 9b2c38144d56447cbdae3483c10089ce (table test-table [id=566551d204284d14b888bd343082a6e4]) successfully deleted
I20260807 06:43:08.100539 14153 tablet_bootstrap.cc:492] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Bootstrap starting.
I20260807 06:43:08.100685 14154 tablet_bootstrap.cc:492] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: No bootstrap required, opened a new log
I20260807 06:43:08.100733 14154 ts_tablet_manager.cc:1397] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 06:43:08.100842 14154 raft_consensus.cc:348] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.100925 14154 raft_consensus.cc:374] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.100946 14154 raft_consensus.cc:729] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d909d19e7154799897cfc01446b03dc, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.100994 14153 tablet_bootstrap.cc:654] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.100991 14154 consensus_queue.cc:260] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.101089 14154 ts_tablet_manager.cc:1428] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:08.101450 14186 ts_tablet_manager.cc:1905] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:08.101791 14153 tablet_bootstrap.cc:492] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: No bootstrap required, opened a new log
I20260807 06:43:08.101840 14153 ts_tablet_manager.cc:1397] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:08.101972 14153 raft_consensus.cc:348] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.102044 14153 raft_consensus.cc:374] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.102066 14153 raft_consensus.cc:729] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ddc31b1e5c49aab24a882b11f9c613, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.102120 14153 consensus_queue.cc:260] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.102206 14153 ts_tablet_manager.cc:1428] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:08.102661 14186 ts_tablet_manager.cc:1918] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:08.102741 14186 log.cc:1196] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/9b2c38144d56447cbdae3483c10089ce
I20260807 06:43:08.102968 14186 ts_tablet_manager.cc:1939] T 9b2c38144d56447cbdae3483c10089ce P 66ef080ec84140a989cdcf3b92db4756: Deleting consensus metadata
I20260807 06:43:08.103416 13405 catalog_manager.cc:4841] TS 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465): tablet 9b2c38144d56447cbdae3483c10089ce (table test-table [id=566551d204284d14b888bd343082a6e4]) successfully deleted
I20260807 06:43:08.103459 14188 ts_tablet_manager.cc:1905] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:08.104688 14188 ts_tablet_manager.cc:1918] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:08.104746 14188 log.cc:1196] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/9b2c38144d56447cbdae3483c10089ce
I20260807 06:43:08.105011 14188 ts_tablet_manager.cc:1939] T 9b2c38144d56447cbdae3483c10089ce P a7ddc31b1e5c49aab24a882b11f9c613: Deleting consensus metadata
I20260807 06:43:08.105486 13402 catalog_manager.cc:4841] TS a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473): tablet 9b2c38144d56447cbdae3483c10089ce (table test-table [id=566551d204284d14b888bd343082a6e4]) successfully deleted
W20260807 06:43:08.175545 13719 tablet.cc:2369] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:08.218384 14160 raft_consensus.cc:482] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:08.218483 14160 raft_consensus.cc:504] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.218816 14160 leader_election.cc:288] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d909d19e7154799897cfc01446b03dc (127.11.137.130:32989), a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:08.221954 14193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.219012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:32989 (local address 127.11.137.129:52947)
0807 06:43:08.219182 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.219193 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.219264 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.219404 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.219405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.219408 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.219494 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.219498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.220126 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.220127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.220996 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.220999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.221645 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.221646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.221729 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.221732 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.221786 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.221817 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":30,"thread_start_us":96,"threads_started":1}
I20260807 06:43:08.221949 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.219112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:52947 (local address 127.11.137.130:32989)
0807 06:43:08.219164 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.219166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.219274 (+ 108us) server_negotiation.cc:407] Connection header received
0807 06:43:08.219314 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.219315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.219327 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.219380 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.219578 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.220038 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.221102 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.221554 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.221614 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.221621 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.221831 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.221873 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:43:08.221980 14146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.219180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:56175 (local address 127.11.137.131:34473)
0807 06:43:08.219231 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.219233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.219247 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:43:08.219347 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.219348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.219358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.219417 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:08.219615 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.220044 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.221153 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.221573 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.221669 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.221677 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.221870 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.221911 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:08.221985 14194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.219050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:34473 (local address 127.11.137.129:56175)
0807 06:43:08.219196 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.219206 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.219270 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.219438 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.219439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.219441 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:08.219513 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.219514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.220148 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.220149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.221001 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.221004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.221702 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.221703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.221758 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.221761 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.221847 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.221887 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":42,"thread_start_us":67,"threads_started":1}
I20260807 06:43:08.222219 14048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "639c4afe4cbc4c738d10c6d066d5bc28" candidate_uuid: "66ef080ec84140a989cdcf3b92db4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" is_pre_election: true
I20260807 06:43:08.222256 13852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "639c4afe4cbc4c738d10c6d066d5bc28" candidate_uuid: "66ef080ec84140a989cdcf3b92db4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d909d19e7154799897cfc01446b03dc" is_pre_election: true
I20260807 06:43:08.222325 14048 raft_consensus.cc:2454] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ef080ec84140a989cdcf3b92db4756 in term 0.
I20260807 06:43:08.222381 13852 raft_consensus.cc:2454] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ef080ec84140a989cdcf3b92db4756 in term 0.
I20260807 06:43:08.222586 13558 leader_election.cc:302] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66ef080ec84140a989cdcf3b92db4756, a7ddc31b1e5c49aab24a882b11f9c613; no voters:
I20260807 06:43:08.222754 14160 raft_consensus.cc:2781] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:08.222808 14160 raft_consensus.cc:482] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:08.222829 14160 raft_consensus.cc:3037] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.223480 14160 raft_consensus.cc:504] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.223618 14160 leader_election.cc:288] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [CANDIDATE]: Term 1 election: Requested vote from peers 2d909d19e7154799897cfc01446b03dc (127.11.137.130:32989), a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:08.223757 13852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "639c4afe4cbc4c738d10c6d066d5bc28" candidate_uuid: "66ef080ec84140a989cdcf3b92db4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d909d19e7154799897cfc01446b03dc"
I20260807 06:43:08.223855 13852 raft_consensus.cc:3037] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.223834 14048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "639c4afe4cbc4c738d10c6d066d5bc28" candidate_uuid: "66ef080ec84140a989cdcf3b92db4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ddc31b1e5c49aab24a882b11f9c613"
I20260807 06:43:08.223940 14048 raft_consensus.cc:3037] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.224471 13852 raft_consensus.cc:2454] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ef080ec84140a989cdcf3b92db4756 in term 1.
I20260807 06:43:08.224676 14048 raft_consensus.cc:2454] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ef080ec84140a989cdcf3b92db4756 in term 1.
I20260807 06:43:08.224666 13561 leader_election.cc:302] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d909d19e7154799897cfc01446b03dc, 66ef080ec84140a989cdcf3b92db4756; no voters:
I20260807 06:43:08.224784 14160 raft_consensus.cc:2781] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:08.224890 14160 raft_consensus.cc:686] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 1 LEADER]: Becoming Leader. State: Replica: 66ef080ec84140a989cdcf3b92db4756, State: Running, Role: LEADER
I20260807 06:43:08.224956 14160 consensus_queue.cc:237] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.225651 13423 catalog_manager.cc:5495] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "66ef080ec84140a989cdcf3b92db4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } health_report { overall_health: UNKNOWN } } }
W20260807 06:43:08.240692 14118 tablet.cc:2369] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084987, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:08.280908 14209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.274022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42355 (local address 127.0.0.1:48832)
0807 06:43:08.274244 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.274254 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.274318 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.274460 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.274461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.274786 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:08.274842 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.274843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.275525 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.275526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.276042 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.276043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.276359 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.276359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.276398 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.276929 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:08.276933 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:08.278404 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:08.279812 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:08.279821 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:08.279823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:08.280013 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:08.280217 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:08.280217 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:08.280218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:08.280278 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:08.280516 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:08.280524 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:08.280570 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.280655 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.280774 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":111,"threads_started":1}
I20260807 06:43:08.280961 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.274114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48832 (local address 127.11.137.190:42355)
0807 06:43:08.274208 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.274210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.274321 (+ 111us) server_negotiation.cc:407] Connection header received
0807 06:43:08.274365 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.274366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.274377 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.274441 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:08.274920 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.275458 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.276117 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.276293 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.276346 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.278503 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:08.278504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:08.278504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:08.278513 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:08.279725 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.280089 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.280090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.280091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.280146 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.280343 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.280344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.280345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.280449 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:08.280526 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.280688 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.280839 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":64}
I20260807 06:43:08.283093 13423 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:48832:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:43:08.283411 13423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:08.284916 13820 tablet_service.cc:1467] Processing CreateTablet for tablet b7e66ed7787646e9b9765e4f6889267e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4876fd400f6848c783b28b8f2c158af7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:08.284930 13618 tablet_service.cc:1467] Processing CreateTablet for tablet b7e66ed7787646e9b9765e4f6889267e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4876fd400f6848c783b28b8f2c158af7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:08.284919 14008 tablet_service.cc:1467] Processing CreateTablet for tablet b7e66ed7787646e9b9765e4f6889267e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4876fd400f6848c783b28b8f2c158af7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:08.285145 13618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7e66ed7787646e9b9765e4f6889267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.285145 14008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7e66ed7787646e9b9765e4f6889267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.285156 13820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7e66ed7787646e9b9765e4f6889267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:08.287906 14154 tablet_bootstrap.cc:492] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: Bootstrap starting.
I20260807 06:43:08.287938 14150 tablet_bootstrap.cc:492] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: Bootstrap starting.
I20260807 06:43:08.287938 14153 tablet_bootstrap.cc:492] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: Bootstrap starting.
I20260807 06:43:08.288233 14154 tablet_bootstrap.cc:654] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.288430 14153 tablet_bootstrap.cc:654] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.288430 14150 tablet_bootstrap.cc:654] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:08.289148 14150 tablet_bootstrap.cc:492] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: No bootstrap required, opened a new log
I20260807 06:43:08.289186 14153 tablet_bootstrap.cc:492] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: No bootstrap required, opened a new log
I20260807 06:43:08.289252 14150 ts_tablet_manager.cc:1397] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:08.289260 14153 ts_tablet_manager.cc:1397] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:08.289395 14154 tablet_bootstrap.cc:492] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: No bootstrap required, opened a new log
I20260807 06:43:08.289449 14154 ts_tablet_manager.cc:1397] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:08.289418 14153 raft_consensus.cc:348] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.289415 14150 raft_consensus.cc:348] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.289495 14153 raft_consensus.cc:374] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.289512 14150 raft_consensus.cc:374] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.289517 14153 raft_consensus.cc:729] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ddc31b1e5c49aab24a882b11f9c613, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.289533 14150 raft_consensus.cc:729] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ef080ec84140a989cdcf3b92db4756, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.289558 14153 consensus_queue.cc:260] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.289577 14150 consensus_queue.cc:260] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.289566 14154 raft_consensus.cc:348] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.289633 14154 raft_consensus.cc:374] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:08.289659 14154 raft_consensus.cc:729] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d909d19e7154799897cfc01446b03dc, State: Initialized, Role: FOLLOWER
I20260807 06:43:08.289669 14150 ts_tablet_manager.cc:1428] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:08.289671 14153 ts_tablet_manager.cc:1428] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:08.289700 14154 consensus_queue.cc:260] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.289835 14154 ts_tablet_manager.cc:1428] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:08.289815 14160 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.289817 14161 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.289888 14160 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:08.289929 14161 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:08.289932 14165 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.290012 14165 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 06:43:08.342625 13921 tablet.cc:2369] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:08.359079 14165 raft_consensus.cc:482] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:08.359179 14165 raft_consensus.cc:504] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.359347 14165 leader_election.cc:288] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465), a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:08.359540 13646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7e66ed7787646e9b9765e4f6889267e" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ef080ec84140a989cdcf3b92db4756" is_pre_election: true
I20260807 06:43:08.359540 14048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7e66ed7787646e9b9765e4f6889267e" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" is_pre_election: true
I20260807 06:43:08.359643 13646 raft_consensus.cc:2454] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 0.
I20260807 06:43:08.359643 14048 raft_consensus.cc:2454] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 0.
I20260807 06:43:08.359802 13762 leader_election.cc:302] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2d909d19e7154799897cfc01446b03dc, 66ef080ec84140a989cdcf3b92db4756, a7ddc31b1e5c49aab24a882b11f9c613; no voters:
I20260807 06:43:08.359908 14165 raft_consensus.cc:2781] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:08.359937 14165 raft_consensus.cc:482] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:08.359951 14165 raft_consensus.cc:3037] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.360661 14165 raft_consensus.cc:504] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.360811 14165 leader_election.cc:288] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 election: Requested vote from peers 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465), a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473)
I20260807 06:43:08.360970 13646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7e66ed7787646e9b9765e4f6889267e" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ef080ec84140a989cdcf3b92db4756"
I20260807 06:43:08.361042 13646 raft_consensus.cc:3037] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.360991 14048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7e66ed7787646e9b9765e4f6889267e" candidate_uuid: "2d909d19e7154799897cfc01446b03dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ddc31b1e5c49aab24a882b11f9c613"
I20260807 06:43:08.361105 14048 raft_consensus.cc:3037] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:08.361757 13646 raft_consensus.cc:2454] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 1.
I20260807 06:43:08.361761 14048 raft_consensus.cc:2454] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d909d19e7154799897cfc01446b03dc in term 1.
I20260807 06:43:08.361936 13762 leader_election.cc:302] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d909d19e7154799897cfc01446b03dc, 66ef080ec84140a989cdcf3b92db4756; no voters:
I20260807 06:43:08.362048 14165 raft_consensus.cc:2781] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:08.362104 14165 raft_consensus.cc:686] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [term 1 LEADER]: Becoming Leader. State: Replica: 2d909d19e7154799897cfc01446b03dc, State: Running, Role: LEADER
I20260807 06:43:08.362171 14165 consensus_queue.cc:237] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } }
I20260807 06:43:08.362449 14163 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: TxnStatusTablet state changed. Reason: New leader 2d909d19e7154799897cfc01446b03dc. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.362545 14163 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:08.362713 14217 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:43:08.362839 14217 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:43:08.362824 13421 catalog_manager.cc:5495] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d909d19e7154799897cfc01446b03dc (127.11.137.130). New cstate: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:08.383209 14209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.380761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:32989 (local address 127.0.0.1:42484)
0807 06:43:08.380828 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.380839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.380885 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.381057 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.381058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.381060 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:08.381112 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.381115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.381792 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.381793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.382387 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.382389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.382747 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.382748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.382821 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.382836 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.383036 (+ 200us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.383047 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.383094 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.383142 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 06:43:08.383203 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.380816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42484 (local address 127.11.137.130:32989)
0807 06:43:08.380860 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.380862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.380878 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:43:08.380960 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.380961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.380969 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.381042 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:08.381204 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.381693 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.382478 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.382670 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.382748 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.382931 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.382972 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.383034 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.383096 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.383120 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:43:08.384389 13646 raft_consensus.cc:1261] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Refusing update from remote peer 2d909d19e7154799897cfc01446b03dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:08.384425 14048 raft_consensus.cc:1261] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Refusing update from remote peer 2d909d19e7154799897cfc01446b03dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:08.384594 14163 consensus_queue.cc:1035] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:08.384827 14163 consensus_queue.cc:1035] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:08.385247 14160 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: TxnStatusTablet state changed. Reason: New leader 2d909d19e7154799897cfc01446b03dc. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.385375 14160 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:08.385371 14161 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: TxnStatusTablet state changed. Reason: New leader 2d909d19e7154799897cfc01446b03dc. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.385466 14161 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:08.386118 14163 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.386204 14163 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:08.386281 14169 mvcc.cc:205] Tried to move back new op lower bound from 7315804112421011456 to 7315804112331894784. Current Snapshot: MvccSnapshot[applied={T|T < 7315804112421011456 or (T in {7315804112421011456})}]
I20260807 06:43:08.386685 14160 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.386775 14160 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 66ef080ec84140a989cdcf3b92db4756: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:08.386842 14180 mvcc.cc:205] Tried to move back new op lower bound from 7315804112421011456 to 7315804112331894784. Current Snapshot: MvccSnapshot[applied={T|T < 7315804112421011456}]
I20260807 06:43:08.388026 14165 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.388109 14165 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P 2d909d19e7154799897cfc01446b03dc: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:08.388491 14161 tablet_replica.cc:439] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2d909d19e7154799897cfc01446b03dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66ef080ec84140a989cdcf3b92db4756" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44465 } } peers { permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 } } peers { permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 } } }
I20260807 06:43:08.388581 14161 tablet_replica.cc:442] T b7e66ed7787646e9b9765e4f6889267e P a7ddc31b1e5c49aab24a882b11f9c613: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:08.390987 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.388231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34362 (local address 127.11.137.129:44465)
0807 06:43:08.388268 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.388270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.388277 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:08.388307 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.388308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.388329 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.388410 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:08.388650 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.389198 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.390280 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.390461 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.390516 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.390677 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.390781 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.390835 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.390902 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.390919 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:08.396047 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.393530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:34821 (local address 127.11.137.130:32989)
0807 06:43:08.393569 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.393571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.393716 (+ 145us) server_negotiation.cc:407] Connection header received
0807 06:43:08.393779 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.393780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.393791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.393845 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:08.393993 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.394427 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.395347 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.395551 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.395626 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.395817 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.395850 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.395896 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.395953 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.395971 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:43:08.396191 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.393478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:32989 (local address 127.11.137.129:34821)
0807 06:43:08.393632 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.393644 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.393729 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.393848 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.393848 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.393849 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:08.393905 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.393907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.394555 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.394556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.395240 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.395243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.395642 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.395644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.395706 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.395720 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.395896 (+ 176us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.395898 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.395949 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.395991 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260807 06:43:08.398655 14048 raft_consensus.cc:1261] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Refusing update from remote peer 66ef080ec84140a989cdcf3b92db4756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:08.398705 13852 raft_consensus.cc:1261] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Refusing update from remote peer 66ef080ec84140a989cdcf3b92db4756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:08.398936 14160 consensus_queue.cc:1035] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d909d19e7154799897cfc01446b03dc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:08.399293 14195 consensus_queue.cc:1035] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ddc31b1e5c49aab24a882b11f9c613" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:08.409250 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.406693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:50517 (local address 127.11.137.129:44465)
0807 06:43:08.406732 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.406734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.406742 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:08.406804 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.406805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.406812 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.406849 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:08.406948 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.407393 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.408542 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.408786 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.408840 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.409023 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.409049 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.409085 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.409144 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.409158 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:08.409291 14234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.406485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44465 (local address 127.11.137.130:50517)
0807 06:43:08.406681 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:08.406692 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:08.406739 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:08.406853 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:08.406853 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:08.406855 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:08.406897 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.406898 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.407461 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.407462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.408392 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:08.408395 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.408864 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.408865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:08.408923 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.408939 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:08.409092 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:08.409093 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 06:43:08.409143 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 06:43:08.409186 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260807 06:43:08.422403 13422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:08.422505 13422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:08.423159 13422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb0bfec6cf764ba4aad711fbecb3a24c: Sending DeleteTablet for 3 replicas of tablet 639c4afe4cbc4c738d10c6d066d5bc28
I20260807 06:43:08.423421 14008 tablet_service.cc:1514] Processing DeleteTablet for tablet 639c4afe4cbc4c738d10c6d066d5bc28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:08 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:40558
I20260807 06:43:08.423527 14188 tablet_replica.cc:330] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: stopping tablet replica
I20260807 06:43:08.423579 13820 tablet_service.cc:1514] Processing DeleteTablet for tablet 639c4afe4cbc4c738d10c6d066d5bc28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:08 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:42466
I20260807 06:43:08.423600 14188 raft_consensus.cc:2229] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:08.423638 14188 raft_consensus.cc:2258] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:08.423658 14187 tablet_replica.cc:330] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: stopping tablet replica
I20260807 06:43:08.423709 14187 raft_consensus.cc:2229] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:08.423738 14187 raft_consensus.cc:2258] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:08.423990 14188 ts_tablet_manager.cc:1905] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:08.424023 14187 ts_tablet_manager.cc:1905] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:08.425709 14187 ts_tablet_manager.cc:1918] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:08.425767 14187 log.cc:1196] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/639c4afe4cbc4c738d10c6d066d5bc28
I20260807 06:43:08.425971 14187 ts_tablet_manager.cc:1939] T 639c4afe4cbc4c738d10c6d066d5bc28 P 2d909d19e7154799897cfc01446b03dc: Deleting consensus metadata
I20260807 06:43:08.426436 13405 catalog_manager.cc:4841] TS 2d909d19e7154799897cfc01446b03dc (127.11.137.130:32989): tablet 639c4afe4cbc4c738d10c6d066d5bc28 (table test-table [id=010ce468e4e444bf813646e57bb85fbe]) successfully deleted
I20260807 06:43:08.426630 13618 tablet_service.cc:1514] Processing DeleteTablet for tablet 639c4afe4cbc4c738d10c6d066d5bc28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:08 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:34356
I20260807 06:43:08.426692 14188 ts_tablet_manager.cc:1918] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:08.426720 14186 tablet_replica.cc:330] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: stopping tablet replica
I20260807 06:43:08.426748 14188 log.cc:1196] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/639c4afe4cbc4c738d10c6d066d5bc28
I20260807 06:43:08.426769 14186 raft_consensus.cc:2229] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:08.426839 14186 raft_consensus.cc:2258] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:08.426967 14188 ts_tablet_manager.cc:1939] T 639c4afe4cbc4c738d10c6d066d5bc28 P a7ddc31b1e5c49aab24a882b11f9c613: Deleting consensus metadata
I20260807 06:43:08.427175 14186 ts_tablet_manager.cc:1905] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:08.428710 14186 ts_tablet_manager.cc:1918] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:08.428776 14186 log.cc:1196] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/639c4afe4cbc4c738d10c6d066d5bc28
I20260807 06:43:08.429004 14186 ts_tablet_manager.cc:1939] T 639c4afe4cbc4c738d10c6d066d5bc28 P 66ef080ec84140a989cdcf3b92db4756: Deleting consensus metadata
I20260807 06:43:08.429358 13402 catalog_manager.cc:4841] TS a7ddc31b1e5c49aab24a882b11f9c613 (127.11.137.131:34473): tablet 639c4afe4cbc4c738d10c6d066d5bc28 (table test-table [id=010ce468e4e444bf813646e57bb85fbe]) successfully deleted
I20260807 06:43:08.429493 13405 catalog_manager.cc:4841] TS 66ef080ec84140a989cdcf3b92db4756 (127.11.137.129:44465): tablet 639c4afe4cbc4c738d10c6d066d5bc28 (table test-table [id=010ce468e4e444bf813646e57bb85fbe]) successfully deleted
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[13358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084988, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:08.439749 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.427495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.11.137.129:44465)
0807 06:43:08.427536 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.427538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.429442 (+ 1904us) server_negotiation.cc:407] Connection header received
0807 06:43:08.429537 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.429538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.429548 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.429576 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:08.430335 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.431059 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.432071 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.432383 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.432461 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.436226 (+ 3765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:08.436235 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:08.436236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:08.436245 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:08.438331 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.438760 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.438764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.438765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.438855 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.439097 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.439098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.439098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.439279 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:08.439454 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.439529 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.439618 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 06:43:08.440097 13693 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34364
I20260807 06:43:08.449265 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:08.441172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.11.137.190:42355)
0807 06:43:08.441247 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:08.441249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:08.441472 (+ 223us) server_negotiation.cc:407] Connection header received
0807 06:43:08.441525 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:08.441526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:08.441538 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:08.441589 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:08.442217 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.443035 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.444047 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:08.444366 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:08.444443 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:08.446008 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:08.446009 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:08.446010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:08.446017 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:08.447914 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.448355 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.448356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.448356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.448420 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:08.448654 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:08.448655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:08.448655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:08.448788 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:08.448890 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:08.449051 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 06:43:08.449133 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 06:43:08.449697 13422 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836
I20260807 06:43:08.450366 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13530
I20260807 06:43:08.463311 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13729
I20260807 06:43:08.477140 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13930
I20260807 06:43:08.484911 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13376
2026-08-07T06:43:08Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2540 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[14249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[14249](info): set up 2 sockets
Aug 07 06:43:08 dist-test-slave-8hhm krb5kdc[14249](info): commencing operation
krb5kdc: starting...
W20260807 06:43:09.711812 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:09 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:09.831638 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42897
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:09.914151 14265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:09.914367 14265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:09.914405 14265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:09.915524 14265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:09.915587 14265 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:43:09.915609 14265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:09.915642 14265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:09.915669 14265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:09.915692 14265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:09.917150 14265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:42897
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:09.917433 14265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:09.917660 14265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:09.922403 14272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:09.922444 14273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:09.922421 14265 server_base.cc:1034] running on GCE node
W20260807 06:43:09.922403 14275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:09.922888 14265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:09.923180 14265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:09.924324 14265 hybrid_clock.cc:648] HybridClock initialized: now 1786084989924311 us; error 29 us; skew 500 ppm
Aug 07 06:43:09 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:09.926831 14265 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:09.927290 14265 webserver.cc:460] Webserver started at http://127.11.137.190:41199/ using document root <none> and password file <none>
I20260807 06:43:09.927544 14265 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:09.927590 14265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:09.927765 14265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:09.928771 14265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef"
format_stamp: "Formatted at 2026-08-07 06:43:09 on dist-test-slave-8hhm"
server_key: "b044f3fcbf625d7cd979c0cf9c968e5b"
server_key_iv: "38520da44c01318582d83fe94481236a"
server_key_version: "encryptionkey@0"
I20260807 06:43:09.929133 14265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef"
format_stamp: "Formatted at 2026-08-07 06:43:09 on dist-test-slave-8hhm"
server_key: "b044f3fcbf625d7cd979c0cf9c968e5b"
server_key_iv: "38520da44c01318582d83fe94481236a"
server_key_version: "encryptionkey@0"
I20260807 06:43:09.930475 14265 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:09.931227 14287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:09.931418 14265 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:09.931512 14265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef"
format_stamp: "Formatted at 2026-08-07 06:43:09 on dist-test-slave-8hhm"
server_key: "b044f3fcbf625d7cd979c0cf9c968e5b"
server_key_iv: "38520da44c01318582d83fe94481236a"
server_key_version: "encryptionkey@0"
I20260807 06:43:09.931586 14265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:09.947170 14265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:09.949055 14265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:09.949205 14265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:09.954262 14265 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:42897
I20260807 06:43:09.954324 14381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:42897 every 8 connection(s)
I20260807 06:43:09.954622 14265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:09.955235 14382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:09.956645 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14265
I20260807 06:43:09.956722 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:09.956895 11814 external_mini_cluster.cc:1428] Setting key 9a6ed9d695487756f353eae5b6bca471
I20260807 06:43:09.957970 14382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Bootstrap starting.
I20260807 06:43:09.958684 14382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:09.958972 14382 log.cc:824] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:09.959709 14382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: No bootstrap required, opened a new log
I20260807 06:43:09.962050 14382 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42897 } }
I20260807 06:43:09.962219 14382 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:09.962267 14382 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfdc99c8cdfb42eda6812b1de0b6c8ef, State: Initialized, Role: FOLLOWER
I20260807 06:43:09.962495 14382 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42897 } }
I20260807 06:43:09.962599 14382 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:09.962635 14382 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:09.962687 14382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:09.963431 14382 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42897 } }
I20260807 06:43:09.963559 14382 leader_election.cc:302] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfdc99c8cdfb42eda6812b1de0b6c8ef; no voters:
I20260807 06:43:09.963737 14382 leader_election.cc:288] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:09.963785 14391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:09.963980 14391 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [term 1 LEADER]: Becoming Leader. State: Replica: dfdc99c8cdfb42eda6812b1de0b6c8ef, State: Running, Role: LEADER
I20260807 06:43:09.964016 14382 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:09.964140 14391 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42897 } }
Aug 07 06:43:09 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:09.965510 14394 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42897 } } }
I20260807 06:43:09.965618 14394 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:09.965713 14392 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfdc99c8cdfb42eda6812b1de0b6c8ef. Latest consensus state: current_term: 1 leader_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfdc99c8cdfb42eda6812b1de0b6c8ef" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42897 } } }
I20260807 06:43:09.965787 14392 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:09.965931 14411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:09.966483 14411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:09.968111 14411 catalog_manager.cc:1347] Generated new cluster ID: ae44741095b749b5975fe5d83bc68aaf
I20260807 06:43:09.968168 14411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:09.968917 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:09.957469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35560 (local address 127.11.137.190:42897)
0807 06:43:09.957670 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:09.957680 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:09.957712 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:43:09.958228 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:09.958236 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:09.958299 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:09.958470 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:09.959073 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:09.960356 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:09.961124 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:09.961759 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:09.961877 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:09.964756 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:09.964766 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:09.964766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:09.964776 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:09.967138 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:09.967566 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:09.967569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:09.967569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:09.967711 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:09.967945 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:09.967947 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:09.967947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:09.968305 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:09.968474 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:09.968573 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 06:43:09.968709 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260807 06:43:09.985705 14411 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:09.986433 14411 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:09.988896 14411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Generated new TSK 0
I20260807 06:43:09.989094 14411 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:10.023532 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42897
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:10.116012 14421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:10.116216 14421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:10.116241 14421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:10.117434 14421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:10.117476 14421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:10.117496 14421 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:43:10.117509 14421 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:10.117565 14421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:10.118992 14421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:10.119237 14421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:10.119503 14421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:10.124696 14429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:10.124672 14428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:10.124672 14433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:10.125051 14421 server_base.cc:1034] running on GCE node
I20260807 06:43:10.125288 14421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:10.125540 14421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:10.126713 14421 hybrid_clock.cc:648] HybridClock initialized: now 1786084990126700 us; error 26 us; skew 500 ppm
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:10.135687 14421 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:10.136126 14421 webserver.cc:460] Webserver started at http://127.11.137.129:39979/ using document root <none> and password file <none>
I20260807 06:43:10.136353 14421 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:10.136420 14421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:10.136576 14421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:10.137759 14421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "30b86c3540664d01af2575798ced8bf4"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "17ca7080786a077db1059c3d95305a67"
server_key_iv: "2f38c54e4b4cefab913329720d643be0"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.138150 14421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "30b86c3540664d01af2575798ced8bf4"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "17ca7080786a077db1059c3d95305a67"
server_key_iv: "2f38c54e4b4cefab913329720d643be0"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.139508 14421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:10.140256 14441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.140456 14421 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:10.140581 14421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "30b86c3540664d01af2575798ced8bf4"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "17ca7080786a077db1059c3d95305a67"
server_key_iv: "2f38c54e4b4cefab913329720d643be0"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.140661 14421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:10.157395 14421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:10.159214 14421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:10.159379 14421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:10.159863 14421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:10.159956 14421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.160014 14421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:10.160043 14421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:10.168080 14421 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:41537
I20260807 06:43:10.168419 14421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:10.168450 14619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:41537 every 8 connection(s)
I20260807 06:43:10.169283 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14421
I20260807 06:43:10.169391 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:10.169591 11814 external_mini_cluster.cc:1428] Setting key 3de05aaa52402d579b2fb617bf1a704d
I20260807 06:43:10.171253 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.160484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:49831 (local address 127.11.137.190:42897)
0807 06:43:10.160563 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.160565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.160801 (+ 236us) server_negotiation.cc:407] Connection header received
0807 06:43:10.161586 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.161587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.161598 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.161643 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.162585 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.163138 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.164798 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.165130 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.165244 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.167900 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.167902 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.167902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.167910 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.169695 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.170191 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.170192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.170193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.170259 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.170525 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.170526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.170526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.170678 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.170744 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.171101 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.171185 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:43:10.171514 14451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.160429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.11.137.129:49831)
0807 06:43:10.160654 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.160703 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.161474 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.161733 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.161738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.162140 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.162456 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.162463 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.163262 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.163263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.164693 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.164696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.165265 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.165266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.165430 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.166033 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.166042 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.167797 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.169786 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.169795 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.169797 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.170089 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.170332 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.170333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.170334 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.170455 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.170778 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.170786 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.170946 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.171060 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.171248 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":118,"threads_started":1}
I20260807 06:43:10.172216 14620 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42897
I20260807 06:43:10.172317 14620 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:10.172504 14620 heartbeater.cc:511] Master 127.11.137.190:42897 requested a full tablet report, sending...
I20260807 06:43:10.173072 14309 ts_manager.cc:194] Registered new tserver with Master: 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537)
I20260807 06:43:10.174024 14309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:49831
I20260807 06:43:10.179288 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.173415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:60111 (local address 127.11.137.190:42897)
0807 06:43:10.173451 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.173452 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.173461 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:10.173520 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.173520 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.173528 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.173570 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.173904 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.174474 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.175544 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.175727 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.175783 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.176745 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.176746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.176746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.176752 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.178167 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.178560 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.178560 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.178561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.178619 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.178830 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.178831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.178831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.178931 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.178977 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.179170 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.179232 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:43:10.179368 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.173232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.11.137.129:60111)
0807 06:43:10.173399 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.173411 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.173464 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.173596 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.173597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.173784 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.173839 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.173841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.174570 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.174571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.175454 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.175457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.175813 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.175814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.175898 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.176267 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.176272 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.176658 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.178251 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.178252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.178253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.178480 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.178689 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.178690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.178691 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.178763 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.179013 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.179013 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.179062 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.179139 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.179263 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:10.197837 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42897
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:10.278548 14631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:10.278762 14631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:10.278798 14631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:10.279920 14631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:10.279984 14631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:10.280016 14631 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:43:10.280043 14631 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:10.280078 14631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:10.281652 14631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:10.281939 14631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:10.282161 14631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:10.287086 14640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:10.287091 14636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:10.287166 14637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:10.287429 14631 server_base.cc:1034] running on GCE node
I20260807 06:43:10.287621 14631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:10.287892 14631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:10.289060 14631 hybrid_clock.cc:648] HybridClock initialized: now 1786084990289053 us; error 36 us; skew 500 ppm
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:10.291512 14631 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:10.291890 14631 webserver.cc:460] Webserver started at http://127.11.137.130:43331/ using document root <none> and password file <none>
I20260807 06:43:10.292062 14631 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:10.292101 14631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:10.292196 14631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:10.293133 14631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "fd3f62fcac1344f08d28bc6495b95589"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "30c2cfaa8623a0d63f1d3a6739d3b440"
server_key_iv: "900bd3a7912e00237db6fb9ed1e9a9a3"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.293525 14631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "fd3f62fcac1344f08d28bc6495b95589"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "30c2cfaa8623a0d63f1d3a6739d3b440"
server_key_iv: "900bd3a7912e00237db6fb9ed1e9a9a3"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.294747 14631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:10.295547 14648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.295763 14631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:10.295835 14631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "fd3f62fcac1344f08d28bc6495b95589"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "30c2cfaa8623a0d63f1d3a6739d3b440"
server_key_iv: "900bd3a7912e00237db6fb9ed1e9a9a3"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.295887 14631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:10.305781 14631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:10.307401 14631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:10.307502 14631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:10.307912 14631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:10.307945 14631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.307971 14631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:10.308019 14631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:10.315835 14631 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:41801
I20260807 06:43:10.316164 14631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:10.316246 14818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:41801 every 8 connection(s)
I20260807 06:43:10.318432 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.308433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:48767 (local address 127.11.137.190:42897)
0807 06:43:10.308507 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.308510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.308724 (+ 214us) server_negotiation.cc:407] Connection header received
0807 06:43:10.309159 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.309160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.309174 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.309298 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.310050 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.310879 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.312169 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.312419 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.312533 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.315351 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.315352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.315353 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.315362 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.316935 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.317452 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.317454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.317454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.317519 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.317778 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.317779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.317779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.317899 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.317971 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.318250 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.318331 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:43:10.318624 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.308360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.11.137.130:48767)
0807 06:43:10.308602 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.308628 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.309067 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.309376 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.309381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.309682 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.309933 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.309938 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.311004 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.311005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.312040 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.312042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.312659 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.312660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.312769 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.313425 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.313444 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.315246 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.317053 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.317061 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.317063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.317370 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.317589 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.317590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.317591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.317707 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.317975 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.317983 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.318118 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.318225 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.318389 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":82,"threads_started":1}
I20260807 06:43:10.319060 14821 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42897
I20260807 06:43:10.319180 14821 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:10.319343 14821 heartbeater.cc:511] Master 127.11.137.190:42897 requested a full tablet report, sending...
I20260807 06:43:10.319744 14312 ts_manager.cc:194] Registered new tserver with Master: fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801)
I20260807 06:43:10.320281 14312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:48767
I20260807 06:43:10.322768 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14631
I20260807 06:43:10.322891 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:10.323091 11814 external_mini_cluster.cc:1428] Setting key 1ae8e580ac098afc1537104d13f99e6a
I20260807 06:43:10.325747 14828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.320023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.11.137.130:43759)
0807 06:43:10.320155 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.320165 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.320226 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.320441 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.320442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.320631 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.320723 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.320725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.321580 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.321581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.322070 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.322071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.322390 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.322391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.322447 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.322820 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.322826 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.323195 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.324741 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.324742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.324743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.324969 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.325157 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.325158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.325159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.325251 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.325496 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.325497 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.325544 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.325610 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.325687 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":17,"thread_start_us":81,"threads_started":1}
I20260807 06:43:10.325870 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.320114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:43759 (local address 127.11.137.190:42897)
0807 06:43:10.320151 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.320152 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.320217 (+ 65us) server_negotiation.cc:407] Connection header received
0807 06:43:10.320298 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.320299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.320306 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.320381 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.320800 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.321496 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.322147 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.322321 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.322378 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.323288 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.323289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.323290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.323298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.324659 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.325044 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.325045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.325045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.325094 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.325313 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.325314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.325314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.325432 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.325482 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.325673 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.325759 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:10.348042 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42897
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:10.428833 14835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:10.429073 14835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:10.429117 14835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:10.430306 14835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:10.430373 14835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:10.430406 14835 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:43:10.430433 14835 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:10.430469 14835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:10.431907 14835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:10.432184 14835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:10.432422 14835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:43:10.437846 14835 server_base.cc:1034] running on GCE node
W20260807 06:43:10.437781 14840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:10.437814 14841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:10.437781 14844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:10.438345 14835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:10.438612 14835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:10.439790 14835 hybrid_clock.cc:648] HybridClock initialized: now 1786084990439784 us; error 41 us; skew 500 ppm
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:10.442375 14835 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:10.442812 14835 webserver.cc:460] Webserver started at http://127.11.137.131:37325/ using document root <none> and password file <none>
I20260807 06:43:10.443099 14835 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:10.443169 14835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:10.443331 14835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:10.444617 14835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "03af626482f5ad7e5a10af644e802481"
server_key_iv: "210ffe58634acc511861ef9292a01807"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.444989 14835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "03af626482f5ad7e5a10af644e802481"
server_key_iv: "210ffe58634acc511861ef9292a01807"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.446400 14835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:10.447113 14856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.447284 14835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:10.447384 14835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86"
format_stamp: "Formatted at 2026-08-07 06:43:10 on dist-test-slave-8hhm"
server_key: "03af626482f5ad7e5a10af644e802481"
server_key_iv: "210ffe58634acc511861ef9292a01807"
server_key_version: "encryptionkey@0"
I20260807 06:43:10.447466 14835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:10.456935 14835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:10.458690 14835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:10.458887 14835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:10.459362 14835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:10.459425 14835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.459468 14835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:10.459493 14835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:10.466820 14835 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:46439
I20260807 06:43:10.466897 15030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:46439 every 8 connection(s)
I20260807 06:43:10.467216 14835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:10.469592 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.459859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:40807 (local address 127.11.137.190:42897)
0807 06:43:10.459898 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.459900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.460111 (+ 211us) server_negotiation.cc:407] Connection header received
0807 06:43:10.460600 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.460602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.460614 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.460679 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.461541 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.462361 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.463366 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.463752 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.463846 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.466673 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.466674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.466674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.466690 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.468166 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.468575 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.468576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.468577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.468638 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.468909 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.468909 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.468910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.469022 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.469096 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.469421 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.469503 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:43:10.469771 14869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.459850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.11.137.131:40807)
0807 06:43:10.459996 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.460029 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.460499 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.460759 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.460764 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.461155 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.461436 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.461441 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.462487 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.462488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.463291 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.463293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.463864 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.463865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.464028 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.464655 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.464665 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.466591 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.468259 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.468266 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.468268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.468490 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.468722 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.468723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.468723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.468835 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.469089 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.469096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.469279 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.469398 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.469548 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":88,"threads_started":1}
I20260807 06:43:10.470229 15032 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42897
I20260807 06:43:10.470301 15032 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:10.470469 15032 heartbeater.cc:511] Master 127.11.137.190:42897 requested a full tablet report, sending...
I20260807 06:43:10.470831 14309 ts_manager.cc:194] Registered new tserver with Master: 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:10.471392 14309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:40807
I20260807 06:43:10.472676 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14835
I20260807 06:43:10.472766 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:10.472922 11814 external_mini_cluster.cc:1428] Setting key 2985484ea8df8754703a854e64aa0eab
I20260807 06:43:10.473810 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:10.477486 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.471205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.11.137.131:57775)
0807 06:43:10.471325 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.471335 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.471378 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.471533 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.471534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.471816 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.471883 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.471886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.472587 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.472588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.473378 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.473381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.473826 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.473827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.473912 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.474351 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.474356 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.474670 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.476495 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.476496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.476496 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.476658 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.476870 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.476871 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.476871 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.476922 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.477196 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.477197 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.477276 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.477344 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.477418 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
I20260807 06:43:10.477596 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.471281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:57775 (local address 127.11.137.190:42897)
0807 06:43:10.471404 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.471406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.471415 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:10.471435 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.471436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.471445 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.471512 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.471959 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.472446 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.473462 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.473747 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.473825 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.474779 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.474781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.474781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.474788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.476407 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.476733 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.476734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.476734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.476803 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.476983 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.476984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.476984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.477133 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.477231 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.477391 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.477475 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:10.498360 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.491331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35574 (local address 127.11.137.190:42897)
0807 06:43:10.491386 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.491388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.491398 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:10.491451 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.491452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.491461 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.491551 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.492158 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.492614 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.493435 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.493619 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.493692 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.495752 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.495754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.495754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.495762 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.497132 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.497541 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.497542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.497542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.497601 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.497807 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.497808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.497808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.497907 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.498009 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.498163 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.498239 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:43:10.499940 14309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:10.501540 14309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:10.507997 15058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.503774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.0.0.1:55964)
0807 06:43:10.503925 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.503965 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.504026 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.504426 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.504429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.504432 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.504495 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.504497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.505562 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.505563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.506742 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.506744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.507672 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.507673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.507762 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.507777 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.507851 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.507905 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":48,"threads_started":1}
I20260807 06:43:10.508059 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.504127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55964 (local address 127.11.137.129:41537)
0807 06:43:10.504275 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.504279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.504287 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:10.504319 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.504321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.504333 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.504421 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.504591 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.505479 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.506841 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.507579 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.507656 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.507720 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.507878 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.507920 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260807 06:43:10.508200 15060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.503863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51240 (local address 127.11.137.131:46439)
0807 06:43:10.504412 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.504418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.504429 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:43:10.504472 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.504474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.504489 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.504596 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.504827 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.505902 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.507135 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.507703 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.507773 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.507826 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.508037 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.508099 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":76,"threads_started":1}
I20260807 06:43:10.508241 15059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.503771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:46439 (local address 127.0.0.1:51240)
0807 06:43:10.503925 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.503966 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.504027 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.504685 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.504686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.504689 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.504743 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.504744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.506007 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.506008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.507050 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.507052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.507861 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.507862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.507915 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.507918 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.507965 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.507995 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":90,"threads_started":1}
I20260807 06:43:10.508538 15061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.503960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:41801 (local address 127.0.0.1:41094)
0807 06:43:10.504097 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.504107 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.504147 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.504849 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.504850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.504852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.504886 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.504887 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.506206 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.506207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.507135 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.507138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.508038 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.508039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.508210 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.508216 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.508423 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.508470 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260807 06:43:10.508899 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.504374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41094 (local address 127.11.137.130:41801)
0807 06:43:10.504580 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.504584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.504594 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:10.504730 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.504732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.504749 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.504957 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.505017 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.506119 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.507210 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.507932 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.508729 (+ 797us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.508773 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.508793 (+ 20us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.508820 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":87,"threads_started":1}
I20260807 06:43:10.508970 14931 tablet_service.cc:1467] Processing CreateTablet for tablet f22781b2c6c44f88842c7d0a0133c259 (DEFAULT_TABLE table=test-table [id=1e2426db0af74aa0bb4b67aa1e1eae29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:10.508985 14514 tablet_service.cc:1467] Processing CreateTablet for tablet f22781b2c6c44f88842c7d0a0133c259 (DEFAULT_TABLE table=test-table [id=1e2426db0af74aa0bb4b67aa1e1eae29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:10.509387 14931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f22781b2c6c44f88842c7d0a0133c259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:10.509387 14514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f22781b2c6c44f88842c7d0a0133c259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:10.509621 14723 tablet_service.cc:1467] Processing CreateTablet for tablet f22781b2c6c44f88842c7d0a0133c259 (DEFAULT_TABLE table=test-table [id=1e2426db0af74aa0bb4b67aa1e1eae29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:10.509958 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f22781b2c6c44f88842c7d0a0133c259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:10.512722 15065 tablet_bootstrap.cc:492] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Bootstrap starting.
I20260807 06:43:10.513146 15068 tablet_bootstrap.cc:492] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Bootstrap starting.
I20260807 06:43:10.513284 15067 tablet_bootstrap.cc:492] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Bootstrap starting.
I20260807 06:43:10.513823 15065 tablet_bootstrap.cc:654] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:10.513880 15067 tablet_bootstrap.cc:654] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:10.513880 15068 tablet_bootstrap.cc:654] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:10.514182 15065 log.cc:824] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:10.514235 15068 log.cc:824] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:10.514246 15067 log.cc:824] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:10.514990 15065 tablet_bootstrap.cc:492] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: No bootstrap required, opened a new log
I20260807 06:43:10.514990 15067 tablet_bootstrap.cc:492] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: No bootstrap required, opened a new log
I20260807 06:43:10.515067 15065 ts_tablet_manager.cc:1397] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:10.515067 15067 ts_tablet_manager.cc:1397] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:10.515193 15068 tablet_bootstrap.cc:492] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: No bootstrap required, opened a new log
I20260807 06:43:10.515268 15068 ts_tablet_manager.cc:1397] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 06:43:10.516824 15068 raft_consensus.cc:348] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.516983 15068 raft_consensus.cc:374] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:10.517038 15068 raft_consensus.cc:729] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b86c3540664d01af2575798ced8bf4, State: Initialized, Role: FOLLOWER
I20260807 06:43:10.517172 15068 consensus_queue.cc:260] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.517107 15067 raft_consensus.cc:348] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.517107 15065 raft_consensus.cc:348] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.517304 15067 raft_consensus.cc:374] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:10.517315 15065 raft_consensus.cc:374] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:10.517356 15065 raft_consensus.cc:729] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Initialized, Role: FOLLOWER
I20260807 06:43:10.517356 15067 raft_consensus.cc:729] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Initialized, Role: FOLLOWER
I20260807 06:43:10.517488 15068 ts_tablet_manager.cc:1428] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 06:43:10.517462 15065 consensus_queue.cc:260] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.517479 15067 consensus_queue.cc:260] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.517637 14620 heartbeater.cc:503] Master 127.11.137.190:42897 was elected leader, sending a full tablet report...
I20260807 06:43:10.517745 15065 ts_tablet_manager.cc:1428] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:10.517912 15032 heartbeater.cc:503] Master 127.11.137.190:42897 was elected leader, sending a full tablet report...
I20260807 06:43:10.518435 14821 heartbeater.cc:503] Master 127.11.137.190:42897 was elected leader, sending a full tablet report...
I20260807 06:43:10.518817 15067 ts_tablet_manager.cc:1428] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
W20260807 06:43:10.566736 14822 tablet.cc:2369] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:43:10.669389 14621 tablet.cc:2369] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:43:10.717905 15034 tablet.cc:2369] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:10.838423 15079 raft_consensus.cc:482] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:10.838549 15079 raft_consensus.cc:504] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.838876 15079 leader_election.cc:288] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801)
I20260807 06:43:10.841913 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.839189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:38971 (local address 127.11.137.129:41537)
0807 06:43:10.839272 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.839274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.839288 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:43:10.839383 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.839384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.839394 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.839470 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.839665 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.840170 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.841119 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.841549 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.841644 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.841652 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.841806 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.841849 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:43:10.841912 14869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.839114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.11.137.131:38971)
0807 06:43:10.839188 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.839203 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.839285 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.839483 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.839484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.839486 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.839572 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.839574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.840265 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.840267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.841021 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.841023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.841643 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.841644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.841732 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.841735 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.841800 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.841839 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 06:43:10.842164 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.839411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:39445 (local address 127.11.137.130:41801)
0807 06:43:10.839472 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.839474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.839579 (+ 105us) server_negotiation.cc:407] Connection header received
0807 06:43:10.839697 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.839698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.839706 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.839780 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.839962 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.840420 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.841373 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.841724 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.841807 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.841814 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.842034 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.842085 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 06:43:10.842298 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f22781b2c6c44f88842c7d0a0133c259" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4" is_pre_election: true
I20260807 06:43:10.842401 15082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.839245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:41801 (local address 127.11.137.131:39445)
0807 06:43:10.839504 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.839520 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.839596 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.839787 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.839787 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.839789 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.839875 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.839877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.840508 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.840509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.841280 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.841283 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.841807 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.841809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.841890 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.841893 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.842275 (+ 382us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.842318 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":103,"threads_started":1}
I20260807 06:43:10.842489 14550 raft_consensus.cc:2454] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 0.
I20260807 06:43:10.842710 14857 leader_election.cc:302] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bc1b8bd0d2428a81ec96c6a6ebff86, 30b86c3540664d01af2575798ced8bf4; no voters:
I20260807 06:43:10.842785 14751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f22781b2c6c44f88842c7d0a0133c259" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3f62fcac1344f08d28bc6495b95589" is_pre_election: true
I20260807 06:43:10.842854 15079 raft_consensus.cc:2781] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:10.842907 15079 raft_consensus.cc:482] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:10.842934 15079 raft_consensus.cc:3037] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:10.842941 14751 raft_consensus.cc:2454] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 0.
I20260807 06:43:10.843998 15079 raft_consensus.cc:504] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.844128 15079 leader_election.cc:288] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 election: Requested vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801)
I20260807 06:43:10.844370 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f22781b2c6c44f88842c7d0a0133c259" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4"
I20260807 06:43:10.844465 14550 raft_consensus.cc:3037] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:10.844589 14751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f22781b2c6c44f88842c7d0a0133c259" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3f62fcac1344f08d28bc6495b95589"
I20260807 06:43:10.844702 14751 raft_consensus.cc:3037] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:10.845516 14550 raft_consensus.cc:2454] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 1.
I20260807 06:43:10.845677 14857 leader_election.cc:302] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bc1b8bd0d2428a81ec96c6a6ebff86, 30b86c3540664d01af2575798ced8bf4; no voters:
I20260807 06:43:10.845728 14751 raft_consensus.cc:2454] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 1.
I20260807 06:43:10.845777 15079 raft_consensus.cc:2781] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:10.845891 15079 raft_consensus.cc:686] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 LEADER]: Becoming Leader. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Running, Role: LEADER
I20260807 06:43:10.845958 15079 consensus_queue.cc:237] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } }
I20260807 06:43:10.846947 14312 catalog_manager.cc:5495] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:43:10 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:10.880332 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.873933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.11.137.190:42897)
0807 06:43:10.873995 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.873997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.874119 (+ 122us) server_negotiation.cc:407] Connection header received
0807 06:43:10.874161 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.874161 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.874170 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.874221 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:10.874629 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.875098 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.875791 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.875962 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.876013 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.878055 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:10.878056 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:10.878057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:10.878063 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:10.879431 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.879747 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.879748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.879748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.879797 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:10.879956 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:10.879956 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:10.879956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:10.880047 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:10.880109 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.880206 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.880271 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:10.880475 15092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.873896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42897 (local address 127.0.0.1:35582)
0807 06:43:10.874050 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.874061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.874119 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.874234 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.874234 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.874523 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:10.874568 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.874569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.875163 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.875164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.875710 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.875711 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.876027 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.876028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.876065 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.876600 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:10.876605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:10.877961 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:10.879498 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.879503 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.879505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.879686 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.879852 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:10.879853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:10.879853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:10.879906 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:10.880101 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:10.880107 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:10.880143 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.880192 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.880338 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":62,"thread_start_us":94,"threads_started":1}
I20260807 06:43:10.882890 14312 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:35582:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:43:10.883096 14312 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:10.884912 14931 tablet_service.cc:1467] Processing CreateTablet for tablet 29eed1d3f47c407abf5bf7557d4ca68b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eb49608867de4bb58d19d2ea583d84a6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:10.885108 14931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eed1d3f47c407abf5bf7557d4ca68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:10.885568 14723 tablet_service.cc:1467] Processing CreateTablet for tablet 29eed1d3f47c407abf5bf7557d4ca68b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eb49608867de4bb58d19d2ea583d84a6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:10.885566 14514 tablet_service.cc:1467] Processing CreateTablet for tablet 29eed1d3f47c407abf5bf7557d4ca68b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eb49608867de4bb58d19d2ea583d84a6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:10.885730 14514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eed1d3f47c407abf5bf7557d4ca68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:10.885742 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eed1d3f47c407abf5bf7557d4ca68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:10.886829 15065 tablet_bootstrap.cc:492] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: Bootstrap starting.
I20260807 06:43:10.887266 15065 tablet_bootstrap.cc:654] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:10.887392 15068 tablet_bootstrap.cc:492] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: Bootstrap starting.
I20260807 06:43:10.887804 15068 tablet_bootstrap.cc:654] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:10.888123 15065 tablet_bootstrap.cc:492] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: No bootstrap required, opened a new log
I20260807 06:43:10.888180 15067 tablet_bootstrap.cc:492] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: Bootstrap starting.
I20260807 06:43:10.888181 15065 ts_tablet_manager.cc:1397] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:10.888355 15065 raft_consensus.cc:348] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.888437 15065 raft_consensus.cc:374] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:10.888458 15065 raft_consensus.cc:729] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Initialized, Role: FOLLOWER
I20260807 06:43:10.888504 15065 consensus_queue.cc:260] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.888581 15068 tablet_bootstrap.cc:492] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: No bootstrap required, opened a new log
I20260807 06:43:10.888630 15068 ts_tablet_manager.cc:1397] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:43:10.888630 15065 ts_tablet_manager.cc:1428] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.888670 15067 tablet_bootstrap.cc:654] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:10.888782 15068 raft_consensus.cc:348] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.888855 15068 raft_consensus.cc:374] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:10.888878 15068 raft_consensus.cc:729] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b86c3540664d01af2575798ced8bf4, State: Initialized, Role: FOLLOWER
I20260807 06:43:10.888926 15068 consensus_queue.cc:260] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.889025 15068 ts_tablet_manager.cc:1428] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.889087 15077 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.889192 15077 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.889149 15079 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.889268 15079 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.889559 15067 tablet_bootstrap.cc:492] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: No bootstrap required, opened a new log
I20260807 06:43:10.889608 15067 ts_tablet_manager.cc:1397] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:10.889761 15067 raft_consensus.cc:348] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.889843 15067 raft_consensus.cc:374] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:10.889874 15067 raft_consensus.cc:729] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Initialized, Role: FOLLOWER
I20260807 06:43:10.889917 15067 consensus_queue.cc:260] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.890057 15067 ts_tablet_manager.cc:1428] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:10.890142 15081 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.890228 15081 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.965180 15077 raft_consensus.cc:482] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:10.965373 15077 raft_consensus.cc:504] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.965768 15077 leader_election.cc:288] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801), 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:10.968719 15060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.966017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:54773 (local address 127.11.137.131:46439)
0807 06:43:10.966094 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.966096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.966240 (+ 144us) server_negotiation.cc:407] Connection header received
0807 06:43:10.966302 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.966303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.966313 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.966362 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.966544 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.967011 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.967971 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.968329 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.968409 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.968437 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.968610 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.968646 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:43:10.968755 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.965980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:50783 (local address 127.11.137.130:41801)
0807 06:43:10.966029 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.966031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.966174 (+ 143us) server_negotiation.cc:407] Connection header received
0807 06:43:10.966213 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.966214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.966222 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.966289 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:10.966480 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.966953 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.967970 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.968378 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.968474 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.968482 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.968645 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.968681 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:43:10.968806 15097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.965926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:41801 (local address 127.11.137.129:50783)
0807 06:43:10.966080 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.966093 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.966163 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.966310 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.966311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.966314 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.966403 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.966405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.967033 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.967034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.967869 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.967871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.968487 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.968488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.968571 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.968574 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.968639 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.968687 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":19,"thread_start_us":91,"threads_started":1}
I20260807 06:43:10.969116 15098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.965958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:46439 (local address 127.11.137.129:54773)
0807 06:43:10.966187 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.966197 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.966249 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.966364 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.966364 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.966366 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:10.966468 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.966469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.967115 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.967116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.967875 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.967877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.968461 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.968462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.968531 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.968534 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.968605 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.968643 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":40,"thread_start_us":69,"threads_started":1}
I20260807 06:43:10.969148 14751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eed1d3f47c407abf5bf7557d4ca68b" candidate_uuid: "30b86c3540664d01af2575798ced8bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3f62fcac1344f08d28bc6495b95589" is_pre_election: true
I20260807 06:43:10.969269 14751 raft_consensus.cc:2454] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b86c3540664d01af2575798ced8bf4 in term 0.
I20260807 06:43:10.969496 14442 leader_election.cc:302] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b86c3540664d01af2575798ced8bf4, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:10.969484 14965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eed1d3f47c407abf5bf7557d4ca68b" candidate_uuid: "30b86c3540664d01af2575798ced8bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" is_pre_election: true
I20260807 06:43:10.969594 14965 raft_consensus.cc:2454] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b86c3540664d01af2575798ced8bf4 in term 0.
I20260807 06:43:10.969627 15077 raft_consensus.cc:2781] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:10.969664 15077 raft_consensus.cc:482] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:10.969698 15077 raft_consensus.cc:3037] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:10.970402 15077 raft_consensus.cc:504] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.970544 15077 leader_election.cc:288] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [CANDIDATE]: Term 1 election: Requested vote from peers fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801), 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:10.970711 14751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eed1d3f47c407abf5bf7557d4ca68b" candidate_uuid: "30b86c3540664d01af2575798ced8bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3f62fcac1344f08d28bc6495b95589"
I20260807 06:43:10.970788 14751 raft_consensus.cc:3037] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:10.971411 14751 raft_consensus.cc:2454] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b86c3540664d01af2575798ced8bf4 in term 1.
I20260807 06:43:10.971540 14965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eed1d3f47c407abf5bf7557d4ca68b" candidate_uuid: "30b86c3540664d01af2575798ced8bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86"
I20260807 06:43:10.971623 14965 raft_consensus.cc:3037] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:10.971603 14442 leader_election.cc:302] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b86c3540664d01af2575798ced8bf4, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:10.972371 14965 raft_consensus.cc:2454] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b86c3540664d01af2575798ced8bf4 in term 1.
I20260807 06:43:10.972497 15077 raft_consensus.cc:2781] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:10.972635 15077 raft_consensus.cc:686] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 30b86c3540664d01af2575798ced8bf4, State: Running, Role: LEADER
I20260807 06:43:10.972728 15077 consensus_queue.cc:237] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:10.973160 15100 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: TxnStatusTablet state changed. Reason: New leader 30b86c3540664d01af2575798ced8bf4. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.973302 15100 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:10.973515 15106 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:43:10.973632 15106 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:43:10.973557 14309 catalog_manager.cc:5495] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30b86c3540664d01af2575798ced8bf4 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:10.983564 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.980914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55978 (local address 127.11.137.129:41537)
0807 06:43:10.980951 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.980953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.980999 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:43:10.981096 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.981097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.981112 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.981171 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:10.981343 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.981805 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.982862 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.983035 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.983081 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.983282 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:10.983367 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:10.983423 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.983498 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.983516 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:43:10.983626 15092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.980859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.0.0.1:55978)
0807 06:43:10.980954 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.980965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.981017 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.981204 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.981205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.981207 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:10.981272 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.981274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.981888 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.981889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.982771 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.982774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.983103 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.983104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:10.983172 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.983190 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:10.983432 (+ 242us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:10.983441 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:43:10.983497 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 06:43:10.983546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 06:43:10.985271 14965 raft_consensus.cc:1261] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Refusing update from remote peer 30b86c3540664d01af2575798ced8bf4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:10.985320 14751 raft_consensus.cc:1261] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Refusing update from remote peer 30b86c3540664d01af2575798ced8bf4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:10.985648 15077 consensus_queue.cc:1035] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:10.985760 15100 consensus_queue.cc:1035] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:10.986876 15079 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: TxnStatusTablet state changed. Reason: New leader 30b86c3540664d01af2575798ced8bf4. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.986990 15079 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.987054 15081 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: TxnStatusTablet state changed. Reason: New leader 30b86c3540664d01af2575798ced8bf4. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.987133 15081 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.987498 15077 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.987578 15077 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:10.987644 15109 mvcc.cc:205] Tried to move back new op lower bound from 7315804123073069056 to 7315804123024723968. Current Snapshot: MvccSnapshot[applied={T|T < 7315804123073069056}]
I20260807 06:43:10.987892 15110 mvcc.cc:205] Tried to move back new op lower bound from 7315804123073069056 to 7315804123024723968. Current Snapshot: MvccSnapshot[applied={T|T < 7315804123073069056}]
I20260807 06:43:10.988402 15079 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.988482 15079 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 17bc1b8bd0d2428a81ec96c6a6ebff86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.989589 15100 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.989671 15100 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P 30b86c3540664d01af2575798ced8bf4: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:10.990163 15081 tablet_replica.cc:439] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30b86c3540664d01af2575798ced8bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } } }
I20260807 06:43:10.990255 15081 tablet_replica.cc:442] T 29eed1d3f47c407abf5bf7557d4ca68b P fd3f62fcac1344f08d28bc6495b95589: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:10.990713 15114 mvcc.cc:205] Tried to move back new op lower bound from 7315804123073069056 to 7315804123024723968. Current Snapshot: MvccSnapshot[applied={T|T < 7315804123073069056 or (T in {7315804123073069056})}]
I20260807 06:43:10.996147 15060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.993591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.11.137.131:46439)
0807 06:43:10.993630 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.993632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.993666 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:43:10.993753 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.993753 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.993767 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.993821 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:10.993942 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.994391 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.995443 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.995611 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.995659 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:10.995844 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:10.995923 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:10.995975 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:10.996038 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 06:43:10.996054 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:11.001104 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.998653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:40677 (local address 127.11.137.129:41537)
0807 06:43:10.998700 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:10.998701 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:10.998726 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:43:10.998752 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:10.998753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:10.998761 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:10.998807 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:10.998950 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.999667 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.000363 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:11.000655 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.000733 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:11.000886 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:11.000918 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:11.000972 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:11.001020 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 06:43:11.001037 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:11.001121 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:10.998497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.11.137.131:40677)
0807 06:43:10.998670 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:10.998679 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:10.998716 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:10.998834 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:10.998835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:10.998836 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:10.998879 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:10.998881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:10.999752 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:10.999753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:11.000285 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:11.000287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:11.000741 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.000741 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:11.000786 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:11.000798 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:11.000981 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:11.000983 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:11.001017 (+ 34us) client_negotiation.cc:240] Negotiation successful
0807 06:43:11.001051 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260807 06:43:11.003372 14751 raft_consensus.cc:1261] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Refusing update from remote peer 17bc1b8bd0d2428a81ec96c6a6ebff86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:11.003412 14550 raft_consensus.cc:1261] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Refusing update from remote peer 17bc1b8bd0d2428a81ec96c6a6ebff86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:11.003603 15079 consensus_queue.cc:1035] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:11.003723 15083 consensus_queue.cc:1035] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:11.012652 15060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:11.009885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:52581 (local address 127.11.137.131:46439)
0807 06:43:11.009923 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:11.009925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:11.010120 (+ 195us) server_negotiation.cc:407] Connection header received
0807 06:43:11.010203 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:11.010204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:11.010213 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:11.010263 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:11.010533 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:11.010979 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.011854 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:11.012134 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.012207 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:11.012426 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:11.012457 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:11.012510 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:11.012588 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 06:43:11.012606 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:11.012909 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:11.009834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:46439 (local address 127.11.137.129:52581)
0807 06:43:11.010046 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:11.010057 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:11.010116 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:11.010372 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:11.010373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:11.010375 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:11.010447 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:11.010449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:11.011064 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.011065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:11.011687 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:11.011689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:11.012221 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:11.012222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:11.012296 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:11.012312 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:11.012528 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:11.012531 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:11.012588 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 06:43:11.012630 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":69,"threads_started":1}
I20260807 06:43:11.022593 14312 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:11.022708 14312 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:11.023444 14312 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Sending DeleteTablet for 3 replicas of tablet f22781b2c6c44f88842c7d0a0133c259
I20260807 06:43:11.023854 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet f22781b2c6c44f88842c7d0a0133c259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:11 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:41094
I20260807 06:43:11.023913 14931 tablet_service.cc:1514] Processing DeleteTablet for tablet f22781b2c6c44f88842c7d0a0133c259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:11 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 06:43:11.023939 14514 tablet_service.cc:1514] Processing DeleteTablet for tablet f22781b2c6c44f88842c7d0a0133c259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:11 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:55964
I20260807 06:43:11.024150 15142 tablet_replica.cc:330] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: stopping tablet replica
I20260807 06:43:11.024252 15142 raft_consensus.cc:2229] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:11.024360 15142 raft_consensus.cc:2258] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:11.024350 14312 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:11.024497 14312 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:11.024758 15142 ts_tablet_manager.cc:1905] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:11.025738 14723 tablet_service.cc:1467] Processing CreateTablet for tablet a603edf66c464e79bb4518623c2f6652 (DEFAULT_TABLE table=test-table [id=b1b168768c0d4a39be09e95248248e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:11.025866 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a603edf66c464e79bb4518623c2f6652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:11.026692 15142 ts_tablet_manager.cc:1918] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:11.026762 15142 log.cc:1196] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/f22781b2c6c44f88842c7d0a0133c259
I20260807 06:43:11.027020 15142 ts_tablet_manager.cc:1939] T f22781b2c6c44f88842c7d0a0133c259 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting consensus metadata
I20260807 06:43:11.027418 15067 tablet_bootstrap.cc:492] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Bootstrap starting.
I20260807 06:43:11.027597 14291 catalog_manager.cc:4841] TS 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439): tablet f22781b2c6c44f88842c7d0a0133c259 (table test-table [id=1e2426db0af74aa0bb4b67aa1e1eae29]) successfully deleted
I20260807 06:43:11.027783 14514 tablet_service.cc:1467] Processing CreateTablet for tablet a603edf66c464e79bb4518623c2f6652 (DEFAULT_TABLE table=test-table [id=b1b168768c0d4a39be09e95248248e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:11.027904 14514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a603edf66c464e79bb4518623c2f6652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:11.028137 15067 tablet_bootstrap.cc:654] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:11.028491 14931 tablet_service.cc:1467] Processing CreateTablet for tablet a603edf66c464e79bb4518623c2f6652 (DEFAULT_TABLE table=test-table [id=b1b168768c0d4a39be09e95248248e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:11.028597 14931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a603edf66c464e79bb4518623c2f6652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:11.029796 15065 tablet_bootstrap.cc:492] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Bootstrap starting.
I20260807 06:43:11.030267 15068 tablet_bootstrap.cc:492] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Bootstrap starting.
I20260807 06:43:11.030311 15065 tablet_bootstrap.cc:654] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:11.030469 15141 tablet_replica.cc:330] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: stopping tablet replica
I20260807 06:43:11.030622 15141 raft_consensus.cc:2229] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:11.030705 15068 tablet_bootstrap.cc:654] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:11.030731 15141 raft_consensus.cc:2258] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:11.031028 15067 tablet_bootstrap.cc:492] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: No bootstrap required, opened a new log
I20260807 06:43:11.031090 15067 ts_tablet_manager.cc:1397] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 06:43:11.031239 15067 raft_consensus.cc:348] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.031335 15067 raft_consensus.cc:374] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:11.031358 15067 raft_consensus.cc:729] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Initialized, Role: FOLLOWER
I20260807 06:43:11.031343 15141 ts_tablet_manager.cc:1905] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:11.031401 15067 consensus_queue.cc:260] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.031491 15067 ts_tablet_manager.cc:1428] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:11.032366 15068 tablet_bootstrap.cc:492] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: No bootstrap required, opened a new log
I20260807 06:43:11.032423 15068 ts_tablet_manager.cc:1397] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260807 06:43:11.032577 15068 raft_consensus.cc:348] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.032665 15068 raft_consensus.cc:374] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:11.032693 15068 raft_consensus.cc:729] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b86c3540664d01af2575798ced8bf4, State: Initialized, Role: FOLLOWER
I20260807 06:43:11.032735 15068 consensus_queue.cc:260] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.032830 15068 ts_tablet_manager.cc:1428] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:11.033296 15140 tablet_replica.cc:330] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: stopping tablet replica
I20260807 06:43:11.033411 15140 raft_consensus.cc:2229] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:11.033481 15140 raft_consensus.cc:2258] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:11.034189 15141 ts_tablet_manager.cc:1918] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:11.034278 15141 log.cc:1196] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/f22781b2c6c44f88842c7d0a0133c259
I20260807 06:43:11.034621 15141 ts_tablet_manager.cc:1939] T f22781b2c6c44f88842c7d0a0133c259 P 30b86c3540664d01af2575798ced8bf4: Deleting consensus metadata
I20260807 06:43:11.034987 14290 catalog_manager.cc:4841] TS 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537): tablet f22781b2c6c44f88842c7d0a0133c259 (table test-table [id=1e2426db0af74aa0bb4b67aa1e1eae29]) successfully deleted
I20260807 06:43:11.035198 15065 tablet_bootstrap.cc:492] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: No bootstrap required, opened a new log
I20260807 06:43:11.035270 15065 ts_tablet_manager.cc:1397] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260807 06:43:11.035418 15065 raft_consensus.cc:348] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.035501 15065 raft_consensus.cc:374] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:11.035526 15065 raft_consensus.cc:729] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Initialized, Role: FOLLOWER
I20260807 06:43:11.035573 15065 consensus_queue.cc:260] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.035673 15065 ts_tablet_manager.cc:1428] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:11.037453 15140 ts_tablet_manager.cc:1905] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:11.038769 15140 ts_tablet_manager.cc:1918] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:11.038842 15140 log.cc:1196] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/f22781b2c6c44f88842c7d0a0133c259
I20260807 06:43:11.039112 15140 ts_tablet_manager.cc:1939] T f22781b2c6c44f88842c7d0a0133c259 P fd3f62fcac1344f08d28bc6495b95589: Deleting consensus metadata
I20260807 06:43:11.039489 14290 catalog_manager.cc:4841] TS fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801): tablet f22781b2c6c44f88842c7d0a0133c259 (table test-table [id=1e2426db0af74aa0bb4b67aa1e1eae29]) successfully deleted
I20260807 06:43:11.083235 15132 raft_consensus.cc:482] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:11.083367 15132 raft_consensus.cc:504] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.083565 15132 leader_election.cc:288] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801)
I20260807 06:43:11.083884 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a603edf66c464e79bb4518623c2f6652" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4" is_pre_election: true
I20260807 06:43:11.083884 14751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a603edf66c464e79bb4518623c2f6652" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3f62fcac1344f08d28bc6495b95589" is_pre_election: true
I20260807 06:43:11.084010 14550 raft_consensus.cc:2454] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 0.
I20260807 06:43:11.084019 14751 raft_consensus.cc:2454] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 0.
I20260807 06:43:11.084206 14857 leader_election.cc:302] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bc1b8bd0d2428a81ec96c6a6ebff86, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:11.084317 15132 raft_consensus.cc:2781] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:11.084371 15132 raft_consensus.cc:482] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:11.084393 15132 raft_consensus.cc:3037] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:11.085268 15132 raft_consensus.cc:504] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.085417 15132 leader_election.cc:288] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 election: Requested vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801)
I20260807 06:43:11.085631 14751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a603edf66c464e79bb4518623c2f6652" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3f62fcac1344f08d28bc6495b95589"
I20260807 06:43:11.085731 14751 raft_consensus.cc:3037] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:11.085681 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a603edf66c464e79bb4518623c2f6652" candidate_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4"
I20260807 06:43:11.085769 14550 raft_consensus.cc:3037] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:11.086536 14751 raft_consensus.cc:2454] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 1.
I20260807 06:43:11.086567 14550 raft_consensus.cc:2454] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17bc1b8bd0d2428a81ec96c6a6ebff86 in term 1.
I20260807 06:43:11.086826 14857 leader_election.cc:302] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bc1b8bd0d2428a81ec96c6a6ebff86, 30b86c3540664d01af2575798ced8bf4; no voters:
I20260807 06:43:11.087008 15132 raft_consensus.cc:2781] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:11.087109 15132 raft_consensus.cc:686] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 LEADER]: Becoming Leader. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Running, Role: LEADER
I20260807 06:43:11.087186 15132 consensus_queue.cc:237] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:11.087867 14309 catalog_manager.cc:5495] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:11.109302 14751 raft_consensus.cc:1261] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Refusing update from remote peer 17bc1b8bd0d2428a81ec96c6a6ebff86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:11.109359 14550 raft_consensus.cc:1261] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Refusing update from remote peer 17bc1b8bd0d2428a81ec96c6a6ebff86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:11.109545 15083 consensus_queue.cc:1035] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:11.109766 15083 consensus_queue.cc:1035] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:43:11.115502 15110 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 06:43:12.634686 14309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:12.634804 14309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:12.635676 14309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Sending DeleteTablet for 3 replicas of tablet a603edf66c464e79bb4518623c2f6652
I20260807 06:43:12.635964 14931 tablet_service.cc:1514] Processing DeleteTablet for tablet a603edf66c464e79bb4518623c2f6652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:12 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 06:43:12.636025 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet a603edf66c464e79bb4518623c2f6652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:12 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:41094
I20260807 06:43:12.636205 15182 tablet_replica.cc:330] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: stopping tablet replica
I20260807 06:43:12.636261 15182 raft_consensus.cc:2229] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:12.636309 15182 raft_consensus.cc:2258] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:12.636329 14514 tablet_service.cc:1514] Processing DeleteTablet for tablet a603edf66c464e79bb4518623c2f6652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:12 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:55964
I20260807 06:43:12.636515 15183 tablet_replica.cc:330] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: stopping tablet replica
I20260807 06:43:12.636526 15184 tablet_replica.cc:330] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: stopping tablet replica
I20260807 06:43:12.636579 15184 raft_consensus.cc:2229] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:12.636569 15183 raft_consensus.cc:2229] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:12.636610 15184 raft_consensus.cc:2258] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:12.636620 15183 raft_consensus.cc:2258] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:12.636838 15184 ts_tablet_manager.cc:1905] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:12.636873 15183 ts_tablet_manager.cc:1905] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:12.638278 15182 ts_tablet_manager.cc:1905] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:12.638676 15184 ts_tablet_manager.cc:1918] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:43:12.638727 15184 log.cc:1196] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/a603edf66c464e79bb4518623c2f6652
I20260807 06:43:12.638860 15183 ts_tablet_manager.cc:1918] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:43:12.638921 15183 log.cc:1196] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/a603edf66c464e79bb4518623c2f6652
I20260807 06:43:12.638938 15184 ts_tablet_manager.cc:1939] T a603edf66c464e79bb4518623c2f6652 P 30b86c3540664d01af2575798ced8bf4: Deleting consensus metadata
I20260807 06:43:12.639250 15183 ts_tablet_manager.cc:1939] T a603edf66c464e79bb4518623c2f6652 P fd3f62fcac1344f08d28bc6495b95589: Deleting consensus metadata
I20260807 06:43:12.639559 14290 catalog_manager.cc:4841] TS fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801): tablet a603edf66c464e79bb4518623c2f6652 (table test-table [id=b1b168768c0d4a39be09e95248248e1c]) successfully deleted
I20260807 06:43:12.640287 14290 catalog_manager.cc:4841] TS 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537): tablet a603edf66c464e79bb4518623c2f6652 (table test-table [id=b1b168768c0d4a39be09e95248248e1c]) successfully deleted
I20260807 06:43:12.640332 15182 ts_tablet_manager.cc:1918] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:43:12.640378 15182 log.cc:1196] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/a603edf66c464e79bb4518623c2f6652
I20260807 06:43:12.640611 15182 ts_tablet_manager.cc:1939] T a603edf66c464e79bb4518623c2f6652 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting consensus metadata
I20260807 06:43:12.640908 14291 catalog_manager.cc:4841] TS 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439): tablet a603edf66c464e79bb4518623c2f6652 (table test-table [id=b1b168768c0d4a39be09e95248248e1c]) successfully deleted
Aug 07 06:43:12 dist-test-slave-8hhm krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084992, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:43:12 dist-test-slave-8hhm krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084992, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:12.662563 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.654968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59224 (local address 127.11.137.190:42897)
0807 06:43:12.655145 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:12.655148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:12.655158 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:12.655227 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:12.655228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:12.655240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:12.655333 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:12.655907 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.656424 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.657283 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.657511 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.657601 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.659959 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:12.659960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:12.659961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:12.659971 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:12.661374 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:12.661733 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:12.661734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:12.661735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:12.661797 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:12.662006 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:12.662007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:12.662007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:12.662125 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:12.662250 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:12.662350 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 06:43:12.662442 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
I20260807 06:43:12.664113 14309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:12.664317 14309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:12.665791 14723 tablet_service.cc:1467] Processing CreateTablet for tablet d944516a4c424bb0b87793d8cb3e9af8 (DEFAULT_TABLE table=test-table [id=011807b67581458097d46ff321fd9042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:12.665791 14931 tablet_service.cc:1467] Processing CreateTablet for tablet d944516a4c424bb0b87793d8cb3e9af8 (DEFAULT_TABLE table=test-table [id=011807b67581458097d46ff321fd9042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:12.665800 14514 tablet_service.cc:1467] Processing CreateTablet for tablet d944516a4c424bb0b87793d8cb3e9af8 (DEFAULT_TABLE table=test-table [id=011807b67581458097d46ff321fd9042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:12.665933 14931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d944516a4c424bb0b87793d8cb3e9af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:12.665933 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d944516a4c424bb0b87793d8cb3e9af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:12.665954 14514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d944516a4c424bb0b87793d8cb3e9af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:12.666981 15199 tablet_bootstrap.cc:492] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Bootstrap starting.
I20260807 06:43:12.667301 15200 tablet_bootstrap.cc:492] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Bootstrap starting.
I20260807 06:43:12.667476 15199 tablet_bootstrap.cc:654] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:12.667572 15203 tablet_bootstrap.cc:492] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Bootstrap starting.
I20260807 06:43:12.667659 15200 tablet_bootstrap.cc:654] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:12.667984 15203 tablet_bootstrap.cc:654] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:12.668339 15199 tablet_bootstrap.cc:492] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: No bootstrap required, opened a new log
I20260807 06:43:12.668380 15199 ts_tablet_manager.cc:1397] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:12.668466 15199 raft_consensus.cc:348] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.668516 15199 raft_consensus.cc:374] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:12.668530 15199 raft_consensus.cc:729] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b86c3540664d01af2575798ced8bf4, State: Initialized, Role: FOLLOWER
I20260807 06:43:12.668568 15199 consensus_queue.cc:260] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.668650 15199 ts_tablet_manager.cc:1428] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:12.668644 15203 tablet_bootstrap.cc:492] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: No bootstrap required, opened a new log
I20260807 06:43:12.668715 15203 ts_tablet_manager.cc:1397] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:12.668831 15203 raft_consensus.cc:348] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.668919 15203 raft_consensus.cc:374] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:12.668948 15203 raft_consensus.cc:729] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Initialized, Role: FOLLOWER
I20260807 06:43:12.669015 15203 consensus_queue.cc:260] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.669143 15203 ts_tablet_manager.cc:1428] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:12.671056 15200 tablet_bootstrap.cc:492] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: No bootstrap required, opened a new log
I20260807 06:43:12.671150 15200 ts_tablet_manager.cc:1397] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 06:43:12.671347 15200 raft_consensus.cc:348] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.671455 15200 raft_consensus.cc:374] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:12.671492 15200 raft_consensus.cc:729] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Initialized, Role: FOLLOWER
I20260807 06:43:12.671579 15200 consensus_queue.cc:260] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.671790 15200 ts_tablet_manager.cc:1428] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:12.831444 15207 raft_consensus.cc:482] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:12.831598 15207 raft_consensus.cc:504] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.832104 15207 leader_election.cc:288] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:12.835551 15209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.832309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.11.137.130:37601)
0807 06:43:12.832604 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:12.832617 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:12.832691 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:12.832880 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:12.832881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:12.832883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:12.832965 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.832966 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.833717 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.833718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.834568 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.834571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.835261 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.835262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.835343 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.835347 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:12.835423 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:43:12.835465 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":2,"thread_start_us":132,"threads_started":1}
I20260807 06:43:12.835546 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.832408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:37601 (local address 127.11.137.129:41537)
0807 06:43:12.832609 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:12.832612 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:12.832750 (+ 138us) server_negotiation.cc:407] Connection header received
0807 06:43:12.832787 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:12.832788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:12.832800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:12.832861 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:12.833050 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.833613 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.834671 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.835177 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.835264 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.835273 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:12.835433 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 06:43:12.835474 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":112,"threads_started":1}
I20260807 06:43:12.835904 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.832367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:46439 (local address 127.11.137.130:58931)
0807 06:43:12.832744 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:12.832756 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:12.832819 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:12.833013 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:12.833014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:12.833017 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:12.833438 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.833440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.834179 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.834180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.834990 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.834992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.835625 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.835626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.835689 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.835693 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:12.835762 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 06:43:12.835806 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":1,"thread_start_us":111,"threads_started":1}
I20260807 06:43:12.835901 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d944516a4c424bb0b87793d8cb3e9af8" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4" is_pre_election: true
I20260807 06:43:12.835986 14550 raft_consensus.cc:2454] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 0.
I20260807 06:43:12.835984 15212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.832599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:58931 (local address 127.11.137.131:46439)
0807 06:43:12.832778 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:12.832781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:12.832805 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:43:12.832913 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:12.832915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:12.832929 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:12.833009 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:12.833528 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.834090 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.835092 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.835505 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.835592 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.835600 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:12.835849 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 06:43:12.835899 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":101,"threads_started":1}
I20260807 06:43:12.836176 14965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d944516a4c424bb0b87793d8cb3e9af8" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" is_pre_election: true
I20260807 06:43:12.836220 14650 leader_election.cc:302] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b86c3540664d01af2575798ced8bf4, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:12.836278 14965 raft_consensus.cc:2454] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 0.
I20260807 06:43:12.836342 15207 raft_consensus.cc:2781] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:12.836393 15207 raft_consensus.cc:482] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:12.836413 15207 raft_consensus.cc:3037] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:12.837137 15207 raft_consensus.cc:504] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.837328 15207 leader_election.cc:288] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 election: Requested vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:12.837489 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d944516a4c424bb0b87793d8cb3e9af8" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4"
I20260807 06:43:12.837567 14550 raft_consensus.cc:3037] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:12.837527 14965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d944516a4c424bb0b87793d8cb3e9af8" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86"
I20260807 06:43:12.837606 14965 raft_consensus.cc:3037] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:12.838153 14550 raft_consensus.cc:2454] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 1.
I20260807 06:43:12.838279 14965 raft_consensus.cc:2454] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 1.
I20260807 06:43:12.838330 14650 leader_election.cc:302] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b86c3540664d01af2575798ced8bf4, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:12.838416 15207 raft_consensus.cc:2781] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:12.838598 15207 raft_consensus.cc:686] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 1 LEADER]: Becoming Leader. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Running, Role: LEADER
I20260807 06:43:12.838678 15207 consensus_queue.cc:237] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.839390 14312 catalog_manager.cc:5495] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "fd3f62fcac1344f08d28bc6495b95589" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:12.851663 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.849440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.11.137.130:41801)
0807 06:43:12.849578 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:12.849579 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:12.849585 (+ 6us) server_negotiation.cc:407] Connection header received
0807 06:43:12.849615 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:12.849615 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:12.849630 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:12.849691 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:12.849783 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.850227 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.850968 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.851180 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.851232 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.851350 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:12.851459 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:12.851508 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:12.851543 (+ 35us) server_negotiation.cc:299] Negotiation successful
0807 06:43:12.851558 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260807 06:43:12.856403 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.854048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49985 (local address 127.11.137.129:41537)
0807 06:43:12.854088 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:12.854090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:12.854243 (+ 153us) server_negotiation.cc:407] Connection header received
0807 06:43:12.854305 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:12.854306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:12.854316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:12.854370 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:12.854497 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.854970 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.855710 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.855905 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.855982 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.856161 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:12.856200 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:12.856261 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:12.856313 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 06:43:12.856335 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:12.856441 15226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.853990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.11.137.130:49985)
0807 06:43:12.854169 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:12.854184 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:12.854256 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:12.854375 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:12.854375 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:12.854377 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:12.854434 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.854435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.855054 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.855055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.855620 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.855621 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.855983 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.855984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.856055 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.856071 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:12.856263 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:12.856265 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:12.856312 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 06:43:12.856354 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260807 06:43:12.858414 14965 raft_consensus.cc:1261] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Refusing update from remote peer fd3f62fcac1344f08d28bc6495b95589: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:12.858435 14550 raft_consensus.cc:1261] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Refusing update from remote peer fd3f62fcac1344f08d28bc6495b95589: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:12.858737 15214 consensus_queue.cc:1035] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:12.858860 15207 consensus_queue.cc:1035] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:12.865787 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.863342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:60165 (local address 127.11.137.130:41801)
0807 06:43:12.863392 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:12.863393 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:12.863511 (+ 118us) server_negotiation.cc:407] Connection header received
0807 06:43:12.863590 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:12.863591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:12.863601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:12.863654 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:12.863781 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.864286 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.865043 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.865243 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.865295 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.865500 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:12.865533 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:12.865565 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:12.865691 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 06:43:12.865716 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 06:43:12.865816 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:12.863294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:41801 (local address 127.11.137.129:60165)
0807 06:43:12.863435 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:12.863446 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:12.863524 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:12.863659 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:12.863660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:12.863662 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:12.863703 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.863704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.864357 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.864357 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.864974 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:12.864976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:12.865321 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:12.865322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:12.865396 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:12.865400 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:12.865625 (+ 225us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:12.865627 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:12.865674 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 06:43:12.865722 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260807 06:43:12.875721 14309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:12.875933 14309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:12.876721 14309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Sending DeleteTablet for 3 replicas of tablet d944516a4c424bb0b87793d8cb3e9af8
I20260807 06:43:12.876994 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet d944516a4c424bb0b87793d8cb3e9af8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:12 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:41094
I20260807 06:43:12.877010 14931 tablet_service.cc:1514] Processing DeleteTablet for tablet d944516a4c424bb0b87793d8cb3e9af8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:12 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 06:43:12.877103 15182 tablet_replica.cc:330] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: stopping tablet replica
I20260807 06:43:12.877116 15183 tablet_replica.cc:330] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: stopping tablet replica
I20260807 06:43:12.877153 15182 raft_consensus.cc:2229] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:12.877167 15183 raft_consensus.cc:2229] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:12.877187 15182 raft_consensus.cc:2258] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:12.877287 15183 raft_consensus.cc:2258] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:12.877625 15182 ts_tablet_manager.cc:1905] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:12.877697 15183 ts_tablet_manager.cc:1905] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:12.877703 14309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:12.877835 14309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:12.878985 14723 tablet_service.cc:1467] Processing CreateTablet for tablet 528d2463bd2d4f74a32f2fac69b1ae81 (DEFAULT_TABLE table=test-table [id=bada459d24a54e978758af657e476de6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:12.879101 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 528d2463bd2d4f74a32f2fac69b1ae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:12.879408 15182 ts_tablet_manager.cc:1918] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:12.879459 15182 log.cc:1196] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/d944516a4c424bb0b87793d8cb3e9af8
I20260807 06:43:12.879623 14514 tablet_service.cc:1514] Processing DeleteTablet for tablet d944516a4c424bb0b87793d8cb3e9af8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:12 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:55964
I20260807 06:43:12.879698 15182 ts_tablet_manager.cc:1939] T d944516a4c424bb0b87793d8cb3e9af8 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting consensus metadata
I20260807 06:43:12.879729 15184 tablet_replica.cc:330] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: stopping tablet replica
I20260807 06:43:12.879781 15184 raft_consensus.cc:2229] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:12.879822 15184 raft_consensus.cc:2258] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:12.879895 14931 tablet_service.cc:1467] Processing CreateTablet for tablet 528d2463bd2d4f74a32f2fac69b1ae81 (DEFAULT_TABLE table=test-table [id=bada459d24a54e978758af657e476de6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:12.879997 14931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 528d2463bd2d4f74a32f2fac69b1ae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:12.880124 15184 ts_tablet_manager.cc:1905] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:12.881314 15203 tablet_bootstrap.cc:492] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Bootstrap starting.
I20260807 06:43:12.881619 15203 tablet_bootstrap.cc:654] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:12.881940 15184 ts_tablet_manager.cc:1918] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:12.881989 15184 log.cc:1196] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/d944516a4c424bb0b87793d8cb3e9af8
I20260807 06:43:12.882154 14291 catalog_manager.cc:4841] TS 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439): tablet d944516a4c424bb0b87793d8cb3e9af8 (table test-table [id=011807b67581458097d46ff321fd9042]) successfully deleted
I20260807 06:43:12.882232 15184 ts_tablet_manager.cc:1939] T d944516a4c424bb0b87793d8cb3e9af8 P 30b86c3540664d01af2575798ced8bf4: Deleting consensus metadata
I20260807 06:43:12.882495 14514 tablet_service.cc:1467] Processing CreateTablet for tablet 528d2463bd2d4f74a32f2fac69b1ae81 (DEFAULT_TABLE table=test-table [id=bada459d24a54e978758af657e476de6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:12.882552 14290 catalog_manager.cc:4841] TS 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537): tablet d944516a4c424bb0b87793d8cb3e9af8 (table test-table [id=011807b67581458097d46ff321fd9042]) successfully deleted
I20260807 06:43:12.882598 14514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 528d2463bd2d4f74a32f2fac69b1ae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:12.883381 15199 tablet_bootstrap.cc:492] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4: Bootstrap starting.
I20260807 06:43:12.883745 15199 tablet_bootstrap.cc:654] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:12.883833 15183 ts_tablet_manager.cc:1918] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:12.883881 15183 log.cc:1196] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/d944516a4c424bb0b87793d8cb3e9af8
I20260807 06:43:12.884097 15183 ts_tablet_manager.cc:1939] T d944516a4c424bb0b87793d8cb3e9af8 P fd3f62fcac1344f08d28bc6495b95589: Deleting consensus metadata
I20260807 06:43:12.884378 14290 catalog_manager.cc:4841] TS fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801): tablet d944516a4c424bb0b87793d8cb3e9af8 (table test-table [id=011807b67581458097d46ff321fd9042]) successfully deleted
I20260807 06:43:12.884868 15200 tablet_bootstrap.cc:492] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Bootstrap starting.
I20260807 06:43:12.885331 15200 tablet_bootstrap.cc:654] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:12.885828 15203 tablet_bootstrap.cc:492] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: No bootstrap required, opened a new log
I20260807 06:43:12.885913 15203 ts_tablet_manager.cc:1397] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260807 06:43:12.886019 15203 raft_consensus.cc:348] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.886086 15203 raft_consensus.cc:374] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:12.886104 15203 raft_consensus.cc:729] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bc1b8bd0d2428a81ec96c6a6ebff86, State: Initialized, Role: FOLLOWER
I20260807 06:43:12.886142 15203 consensus_queue.cc:260] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.886238 15203 ts_tablet_manager.cc:1428] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:12.886662 15199 tablet_bootstrap.cc:492] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4: No bootstrap required, opened a new log
I20260807 06:43:12.886715 15199 ts_tablet_manager.cc:1397] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 06:43:12.886837 15199 raft_consensus.cc:348] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.886924 15199 raft_consensus.cc:374] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:12.886951 15199 raft_consensus.cc:729] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b86c3540664d01af2575798ced8bf4, State: Initialized, Role: FOLLOWER
I20260807 06:43:12.886994 15199 consensus_queue.cc:260] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.887094 15199 ts_tablet_manager.cc:1428] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:12.887526 15200 tablet_bootstrap.cc:492] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: No bootstrap required, opened a new log
I20260807 06:43:12.887579 15200 ts_tablet_manager.cc:1397] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 06:43:12.887774 15200 raft_consensus.cc:348] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.887876 15200 raft_consensus.cc:374] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:12.887909 15200 raft_consensus.cc:729] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Initialized, Role: FOLLOWER
I20260807 06:43:12.887959 15200 consensus_queue.cc:260] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:12.888070 15200 ts_tablet_manager.cc:1428] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:13.061695 15214 raft_consensus.cc:482] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:13.061811 15214 raft_consensus.cc:504] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:13.062006 15214 leader_election.cc:288] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:13.062279 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528d2463bd2d4f74a32f2fac69b1ae81" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4" is_pre_election: true
I20260807 06:43:13.062279 14965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528d2463bd2d4f74a32f2fac69b1ae81" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" is_pre_election: true
I20260807 06:43:13.062405 14965 raft_consensus.cc:2454] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 0.
I20260807 06:43:13.062405 14550 raft_consensus.cc:2454] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 0.
I20260807 06:43:13.062604 14650 leader_election.cc:302] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b86c3540664d01af2575798ced8bf4, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:13.062727 15214 raft_consensus.cc:2781] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:13.062772 15214 raft_consensus.cc:482] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:13.062798 15214 raft_consensus.cc:3037] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:13.063491 15214 raft_consensus.cc:504] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:13.063643 15214 leader_election.cc:288] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 election: Requested vote from peers 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537), 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439)
I20260807 06:43:13.063776 14550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528d2463bd2d4f74a32f2fac69b1ae81" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b86c3540664d01af2575798ced8bf4"
I20260807 06:43:13.063860 14550 raft_consensus.cc:3037] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:13.063819 14965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528d2463bd2d4f74a32f2fac69b1ae81" candidate_uuid: "fd3f62fcac1344f08d28bc6495b95589" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86"
I20260807 06:43:13.063933 14965 raft_consensus.cc:3037] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:13.064514 14550 raft_consensus.cc:2454] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 1.
I20260807 06:43:13.064703 14650 leader_election.cc:302] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b86c3540664d01af2575798ced8bf4, fd3f62fcac1344f08d28bc6495b95589; no voters:
I20260807 06:43:13.064785 14965 raft_consensus.cc:2454] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3f62fcac1344f08d28bc6495b95589 in term 1.
I20260807 06:43:13.064800 15214 raft_consensus.cc:2781] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:13.064847 15214 raft_consensus.cc:686] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 1 LEADER]: Becoming Leader. State: Replica: fd3f62fcac1344f08d28bc6495b95589, State: Running, Role: LEADER
I20260807 06:43:13.064906 15214 consensus_queue.cc:237] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } }
I20260807 06:43:13.065528 14309 catalog_manager.cc:5495] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "fd3f62fcac1344f08d28bc6495b95589" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3f62fcac1344f08d28bc6495b95589" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:13.115720 14965 raft_consensus.cc:1261] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Refusing update from remote peer fd3f62fcac1344f08d28bc6495b95589: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:13.115751 14550 raft_consensus.cc:1261] T 528d2463bd2d4f74a32f2fac69b1ae81 P 30b86c3540664d01af2575798ced8bf4 [term 1 FOLLOWER]: Refusing update from remote peer fd3f62fcac1344f08d28bc6495b95589: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:13.115986 15207 consensus_queue.cc:1035] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17bc1b8bd0d2428a81ec96c6a6ebff86" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 46439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:13.116122 15214 consensus_queue.cc:1035] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b86c3540664d01af2575798ced8bf4" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:43:13.120926 15158 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 06:43:14.641659 14307 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:14.641760 14307 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:14.642663 14307 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfdc99c8cdfb42eda6812b1de0b6c8ef: Sending DeleteTablet for 3 replicas of tablet 528d2463bd2d4f74a32f2fac69b1ae81
I20260807 06:43:14.643046 14931 tablet_service.cc:1514] Processing DeleteTablet for tablet 528d2463bd2d4f74a32f2fac69b1ae81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:14 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 06:43:14.643054 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet 528d2463bd2d4f74a32f2fac69b1ae81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:14 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:41094
I20260807 06:43:14.643054 14514 tablet_service.cc:1514] Processing DeleteTablet for tablet 528d2463bd2d4f74a32f2fac69b1ae81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:14 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:55964
I20260807 06:43:14.643201 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14421
I20260807 06:43:14.645920 15278 tablet_replica.cc:330] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: stopping tablet replica
I20260807 06:43:14.646047 15278 raft_consensus.cc:2229] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:14.646178 15278 raft_consensus.cc:2258] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:14.647742 15278 ts_tablet_manager.cc:1905] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:14.650288 15278 ts_tablet_manager.cc:1918] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:43:14.650408 15278 log.cc:1196] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/528d2463bd2d4f74a32f2fac69b1ae81
I20260807 06:43:14.650542 15279 tablet_replica.cc:330] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: stopping tablet replica
I20260807 06:43:14.651633 15278 ts_tablet_manager.cc:1939] T 528d2463bd2d4f74a32f2fac69b1ae81 P 17bc1b8bd0d2428a81ec96c6a6ebff86: Deleting consensus metadata
I20260807 06:43:14.651767 15279 raft_consensus.cc:2229] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:14.651878 15279 raft_consensus.cc:2258] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:14.652266 14291 catalog_manager.cc:4841] TS 17bc1b8bd0d2428a81ec96c6a6ebff86 (127.11.137.131:46439): tablet 528d2463bd2d4f74a32f2fac69b1ae81 (table test-table [id=bada459d24a54e978758af657e476de6]) successfully deleted
I20260807 06:43:14.652715 15279 ts_tablet_manager.cc:1905] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:14.654619 15279 ts_tablet_manager.cc:1918] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:43:14.654693 15279 log.cc:1196] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/528d2463bd2d4f74a32f2fac69b1ae81
I20260807 06:43:14.654932 15279 ts_tablet_manager.cc:1939] T 528d2463bd2d4f74a32f2fac69b1ae81 P fd3f62fcac1344f08d28bc6495b95589: Deleting consensus metadata
I20260807 06:43:14.655356 14290 catalog_manager.cc:4841] TS fd3f62fcac1344f08d28bc6495b95589 (127.11.137.130:41801): tablet 528d2463bd2d4f74a32f2fac69b1ae81 (table test-table [id=bada459d24a54e978758af657e476de6]) successfully deleted
W20260807 06:43:14.660724 14290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:41537 (error 108)
I20260807 06:43:14.661020 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14631
I20260807 06:43:14.664726 15283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:14.661189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:41537 (local address 127.0.0.1:52700)
0807 06:43:14.664629 (+ 3440us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:14.664679 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:41537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3414,"thread_start_us":80,"threads_started":1}
W20260807 06:43:14.664844 14290 catalog_manager.cc:4584] TS 30b86c3540664d01af2575798ced8bf4 (127.11.137.129:41537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 528d2463bd2d4f74a32f2fac69b1ae81: Network error: Client connection negotiation failed: client connection to 127.11.137.129:41537: connect: Connection refused (error 111)
I20260807 06:43:14.680763 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14835
I20260807 06:43:14.696439 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14265
2026-08-07T06:43:14Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6211 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:14 dist-test-slave-8hhm krb5kdc[15291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:14 dist-test-slave-8hhm krb5kdc[15291](info): set up 2 sockets
Aug 07 06:43:14 dist-test-slave-8hhm krb5kdc[15291](info): commencing operation
krb5kdc: starting...
W20260807 06:43:15.953378 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:16.076781 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40959
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:40959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:16.159070 15308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:16.159265 15308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:16.159286 15308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:16.160341 15308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:16.160375 15308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:16.160390 15308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:16.160403 15308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:16.160414 15308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:16.161906 15308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:40959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:16.162111 15308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:16.162283 15308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:16.167088 15317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.167095 15315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.167102 15314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:16.167527 15308 server_base.cc:1034] running on GCE node
I20260807 06:43:16.167799 15308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:16.168115 15308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:16.169281 15308 hybrid_clock.cc:648] HybridClock initialized: now 1786084996169256 us; error 37 us; skew 500 ppm
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:16.175024 15308 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:16.175513 15308 webserver.cc:460] Webserver started at http://127.11.137.190:42097/ using document root <none> and password file <none>
I20260807 06:43:16.175745 15308 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:16.175813 15308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:16.175978 15308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:16.177098 15308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "d9305485b4f54ed086504d1956e36317"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "14ea737de8d274e78257b0e493168069"
server_key_iv: "8831371740e0ecea77bcc4a5e0db1b1d"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.177551 15308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "d9305485b4f54ed086504d1956e36317"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "14ea737de8d274e78257b0e493168069"
server_key_iv: "8831371740e0ecea77bcc4a5e0db1b1d"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.178872 15308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:16.179600 15328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.179773 15308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:16.179880 15308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "d9305485b4f54ed086504d1956e36317"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "14ea737de8d274e78257b0e493168069"
server_key_iv: "8831371740e0ecea77bcc4a5e0db1b1d"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.179955 15308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:16.192093 15308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:16.193881 15308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:16.194043 15308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:16.198207 15308 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:40959
I20260807 06:43:16.198237 15406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:40959 every 8 connection(s)
I20260807 06:43:16.198604 15308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:16.199451 15407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:16.201721 15407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317: Bootstrap starting.
I20260807 06:43:16.201912 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15308
I20260807 06:43:16.202010 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:16.202172 11814 external_mini_cluster.cc:1428] Setting key 3ec05957c2f85ecda87d9aceb93caa43
I20260807 06:43:16.202406 15407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:16.202750 15407 log.cc:824] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:16.203452 15407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317: No bootstrap required, opened a new log
I20260807 06:43:16.205299 15407 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9305485b4f54ed086504d1956e36317" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40959 } }
I20260807 06:43:16.205461 15407 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:16.205508 15407 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9305485b4f54ed086504d1956e36317, State: Initialized, Role: FOLLOWER
I20260807 06:43:16.205629 15407 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9305485b4f54ed086504d1956e36317" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40959 } }
I20260807 06:43:16.205725 15407 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:16.205770 15407 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:16.205818 15407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:16.206344 15407 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9305485b4f54ed086504d1956e36317" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40959 } }
I20260807 06:43:16.206463 15407 leader_election.cc:302] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9305485b4f54ed086504d1956e36317; no voters:
I20260807 06:43:16.206660 15407 leader_election.cc:288] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:16.206694 15412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:16.206881 15412 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [term 1 LEADER]: Becoming Leader. State: Replica: d9305485b4f54ed086504d1956e36317, State: Running, Role: LEADER
I20260807 06:43:16.207000 15412 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9305485b4f54ed086504d1956e36317" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40959 } }
I20260807 06:43:16.207211 15407 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:16.207346 15413 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9305485b4f54ed086504d1956e36317" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9305485b4f54ed086504d1956e36317" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40959 } } }
I20260807 06:43:16.207435 15413 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:16.207525 15415 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9305485b4f54ed086504d1956e36317. Latest consensus state: current_term: 1 leader_uuid: "d9305485b4f54ed086504d1956e36317" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9305485b4f54ed086504d1956e36317" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40959 } } }
I20260807 06:43:16.207703 15415 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:16.208467 15420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:16.208984 15420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:16.210630 15420 catalog_manager.cc:1347] Generated new cluster ID: a9162808a3c242d98bbe028a647f1bb3
I20260807 06:43:16.210685 15420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:16.213176 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.202660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53526 (local address 127.11.137.190:40959)
0807 06:43:16.202847 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:16.202857 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:16.202890 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:43:16.203348 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:16.203355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:16.203399 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:16.203549 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:16.204187 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.205042 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.206015 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.206431 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.206569 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.209546 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:16.209549 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:16.209550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:16.209561 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:16.211471 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.211924 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.211926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.211927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.212032 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.212273 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.212274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.212274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.212547 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:16.212697 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:16.212829 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 06:43:16.212952 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260807 06:43:16.219129 15420 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:16.219830 15420 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:16.226629 15420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9305485b4f54ed086504d1956e36317: Generated new TSK 0
I20260807 06:43:16.226797 15420 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:16.253688 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40959
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:16.335657 15446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:16.335855 15446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:16.335879 15446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:16.337013 15446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:16.337054 15446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:16.337108 15446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:16.338493 15446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:16.338742 15446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:16.338972 15446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:16.344079 15452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.344060 15458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.344084 15454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:16.344329 15446 server_base.cc:1034] running on GCE node
I20260807 06:43:16.344506 15446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:16.344686 15446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:16.345839 15446 hybrid_clock.cc:648] HybridClock initialized: now 1786084996345823 us; error 27 us; skew 500 ppm
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:16.348469 15446 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:16.348898 15446 webserver.cc:460] Webserver started at http://127.11.137.129:33133/ using document root <none> and password file <none>
I20260807 06:43:16.349134 15446 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:16.349184 15446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:16.349365 15446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:16.350373 15446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "2cd4b276e5b04bde869568fe1cd4ec67"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "d64b690cac0b6779ffb30c1171080dca"
server_key_iv: "54b3c575d8bf6b81f28a3a0d0b2995cf"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.350740 15446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "2cd4b276e5b04bde869568fe1cd4ec67"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "d64b690cac0b6779ffb30c1171080dca"
server_key_iv: "54b3c575d8bf6b81f28a3a0d0b2995cf"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.352089 15446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:16.352795 15465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.352972 15446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:16.353080 15446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "2cd4b276e5b04bde869568fe1cd4ec67"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "d64b690cac0b6779ffb30c1171080dca"
server_key_iv: "54b3c575d8bf6b81f28a3a0d0b2995cf"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.353163 15446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:16.367038 15446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:16.369362 15446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:16.369475 15446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:16.369658 15446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:16.369961 15446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:16.369997 15446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.370054 15446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:16.370080 15446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.375908 15446 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:40475
I20260807 06:43:16.375995 15629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:40475 every 8 connection(s)
I20260807 06:43:16.376387 15446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:16.378409 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15446
I20260807 06:43:16.378512 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:16.378703 11814 external_mini_cluster.cc:1428] Setting key fc61432686214d53d599263b5b2227e0
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:16.386581 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.377200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:41123 (local address 127.11.137.190:40959)
0807 06:43:16.377298 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:16.377300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:16.377473 (+ 173us) server_negotiation.cc:407] Connection header received
0807 06:43:16.378011 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:16.378012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:16.378024 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:16.378095 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:16.379172 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.379736 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.380741 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.381054 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.381127 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.383662 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:16.383663 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:16.383664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:16.383689 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:16.385178 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.385690 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.385691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.385691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.385739 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.386007 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.386008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.386008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.386099 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:16.386144 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:16.386461 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 06:43:16.386523 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 06:43:16.386843 15632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.377115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40959 (local address 127.11.137.129:41123)
0807 06:43:16.377350 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:16.377384 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:16.377901 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:16.378172 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:16.378175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:16.378875 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:16.379059 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:16.379065 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.379845 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.379846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:16.380647 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:16.380649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.381132 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.381133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:16.381313 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.381816 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:16.381824 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:16.383554 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:16.385311 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:16.385318 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:16.385320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:16.385619 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:16.385805 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:16.385806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:16.385807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:16.385941 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:16.386163 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:16.386170 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:16.386325 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 06:43:16.386437 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 06:43:16.386606 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":112,"threads_started":1}
I20260807 06:43:16.387497 15630 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40959
I20260807 06:43:16.387601 15630 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:43:16.387777 15630 heartbeater.cc:511] Master 127.11.137.190:40959 requested a full tablet report, sending...
I20260807 06:43:16.388265 15352 ts_manager.cc:194] Registered new tserver with Master: 2cd4b276e5b04bde869568fe1cd4ec67 (127.11.137.129:40475)
I20260807 06:43:16.388854 15352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:41123
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:16.403803 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40959
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:16.484526 15636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:16.484714 15636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:16.484736 15636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:16.485865 15636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:16.485908 15636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:16.485957 15636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:16.487308 15636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:16.487524 15636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:16.487732 15636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:16.492940 15651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.492933 15647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.492934 15649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:16.493117 15636 server_base.cc:1034] running on GCE node
I20260807 06:43:16.493484 15636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:16.493780 15636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:16.494936 15636 hybrid_clock.cc:648] HybridClock initialized: now 1786084996494927 us; error 40 us; skew 500 ppm
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:16.497433 15636 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:16.497874 15636 webserver.cc:460] Webserver started at http://127.11.137.130:39597/ using document root <none> and password file <none>
I20260807 06:43:16.498042 15636 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:16.498081 15636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:16.498215 15636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:16.499186 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "032e59fcf6d4429d9809f3bf6e69a76b"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "855b42c67ee4d2633b2b40802365fd63"
server_key_iv: "3b35cb945d3c7ca90e5ce80d2bdfb971"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.499538 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "032e59fcf6d4429d9809f3bf6e69a76b"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "855b42c67ee4d2633b2b40802365fd63"
server_key_iv: "3b35cb945d3c7ca90e5ce80d2bdfb971"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.500883 15636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:43:16.501713 15659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.501878 15636 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.501971 15636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "032e59fcf6d4429d9809f3bf6e69a76b"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "855b42c67ee4d2633b2b40802365fd63"
server_key_iv: "3b35cb945d3c7ca90e5ce80d2bdfb971"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.502041 15636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:16.511936 15636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:16.513742 15636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:16.513895 15636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:16.514112 15636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:16.514405 15636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:16.514439 15636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.514460 15636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:16.514506 15636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.520491 15636 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:46861
I20260807 06:43:16.520541 15830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:46861 every 8 connection(s)
I20260807 06:43:16.520843 15636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:16.528576 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15636
I20260807 06:43:16.528702 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:16.528944 11814 external_mini_cluster.cc:1428] Setting key af7168ec54cef84911016aaa094fd749
I20260807 06:43:16.529794 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.521557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:53969 (local address 127.11.137.190:40959)
0807 06:43:16.521629 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:16.521632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:16.521855 (+ 223us) server_negotiation.cc:407] Connection header received
0807 06:43:16.522351 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:16.522352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:16.522362 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:16.522411 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:16.523273 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.523754 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.524660 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.524837 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.524886 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.527032 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:16.527033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:16.527033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:16.527039 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:16.528181 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.528625 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.528626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.528626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.528712 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.529070 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.529071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.529071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.529270 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:16.529355 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:16.529631 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 06:43:16.529714 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:43:16.529982 15834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.521529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40959 (local address 127.11.137.130:53969)
0807 06:43:16.521736 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:16.521770 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:16.522265 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:16.522466 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:16.522469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:16.523019 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:16.523196 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:16.523201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.523836 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.523836 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:16.524588 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:16.524590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.524909 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.524909 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:16.525003 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.525564 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:16.525572 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:16.526948 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:16.528252 (+ 1304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:16.528258 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:16.528259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:16.528549 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:16.528825 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:16.528826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:16.528827 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:16.528971 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:16.529341 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:16.529347 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:16.529473 (+ 126us) client_negotiation.cc:769] Sending connection context
0807 06:43:16.529590 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 06:43:16.529750 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":109,"threads_started":1}
I20260807 06:43:16.531558 15831 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40959
I20260807 06:43:16.531658 15831 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:16.531880 15831 heartbeater.cc:511] Master 127.11.137.190:40959 requested a full tablet report, sending...
I20260807 06:43:16.532263 15352 ts_manager.cc:194] Registered new tserver with Master: 032e59fcf6d4429d9809f3bf6e69a76b (127.11.137.130:46861)
I20260807 06:43:16.532730 15352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:53969
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:16.555418 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40959
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:16.637882 15837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:16.638075 15837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:16.638098 15837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:16.639170 15837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:16.639211 15837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:16.639236 15837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:16.640651 15837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:16.640829 15837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:16.640991 15837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:16.646024 15846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.646123 15853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:16.646070 15849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:16.646131 15837 server_base.cc:1034] running on GCE node
I20260807 06:43:16.646435 15837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:16.646703 15837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:16.647855 15837 hybrid_clock.cc:648] HybridClock initialized: now 1786084996647842 us; error 31 us; skew 500 ppm
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:16.650424 15837 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:16.650795 15837 webserver.cc:460] Webserver started at http://127.11.137.131:38165/ using document root <none> and password file <none>
I20260807 06:43:16.650969 15837 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:16.651008 15837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:16.651099 15837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:16.652081 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "d884bf8fd5d3499e97aae6cb6ebaab08"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "de42949a4cd457bfa7ec8511b9f29003"
server_key_iv: "6c30862e1980e29b969442d278d8329f"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.652387 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "d884bf8fd5d3499e97aae6cb6ebaab08"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "de42949a4cd457bfa7ec8511b9f29003"
server_key_iv: "6c30862e1980e29b969442d278d8329f"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.653748 15837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:16.654430 15861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.654623 15837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:16.654718 15837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "d884bf8fd5d3499e97aae6cb6ebaab08"
format_stamp: "Formatted at 2026-08-07 06:43:16 on dist-test-slave-8hhm"
server_key: "de42949a4cd457bfa7ec8511b9f29003"
server_key_iv: "6c30862e1980e29b969442d278d8329f"
server_key_version: "encryptionkey@0"
I20260807 06:43:16.654795 15837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:16.672677 15837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:16.674602 15837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:16.674762 15837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:16.674998 15837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:16.675305 15837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:16.675340 15837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.675362 15837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:16.675412 15837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:16.681430 15837 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:35265
I20260807 06:43:16.681509 16037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:35265 every 8 connection(s)
I20260807 06:43:16.681839 15837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[15291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084996, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:16.690546 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15837
I20260807 06:43:16.690670 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:16.690876 11814 external_mini_cluster.cc:1428] Setting key f468beb066fe7d958dc6af3b93d8ba29
I20260807 06:43:16.691037 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.682603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49429 (local address 127.11.137.190:40959)
0807 06:43:16.682664 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:16.682666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:16.682896 (+ 230us) server_negotiation.cc:407] Connection header received
0807 06:43:16.683433 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:16.683435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:16.683445 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:16.683498 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:16.684428 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.685071 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.686021 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.686212 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.686265 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.688212 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:16.688214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:16.688214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:16.688220 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:16.689696 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.690045 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.690046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.690046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.690100 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:16.690310 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:16.690310 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:16.690310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:16.690467 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:16.690546 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:16.690854 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 06:43:16.690935 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:16.691218 16042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:16.682590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40959 (local address 127.11.137.131:49429)
0807 06:43:16.682764 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:16.682800 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:16.683316 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:16.683554 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:16.683557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:16.684165 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:16.684350 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:16.684354 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.685154 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.685155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:16.685949 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:16.685952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:16.686285 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:16.686286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:16.686384 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:16.686816 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:16.686823 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:16.688130 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:16.689767 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:16.689773 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:16.689775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:16.689980 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:16.690158 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:16.690158 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:16.690159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:16.690255 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:16.690539 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:16.690542 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:16.690716 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 06:43:16.690821 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 06:43:16.690974 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260807 06:43:16.691744 16039 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40959
I20260807 06:43:16.691851 16039 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:16.692039 16039 heartbeater.cc:511] Master 127.11.137.190:40959 requested a full tablet report, sending...
I20260807 06:43:16.692445 15351 ts_manager.cc:194] Registered new tserver with Master: d884bf8fd5d3499e97aae6cb6ebaab08 (127.11.137.131:35265)
I20260807 06:43:16.692822 15351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:49429
I20260807 06:43:16.702610 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:43:16.716639 15410 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:16.715807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53536 (local address 127.11.137.190:40959)
0807 06:43:16.715865 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:16.715867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:16.715967 (+ 100us) server_negotiation.cc:407] Connection header received
0807 06:43:16.716011 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:16.716012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:16.716021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:16.716076 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:16.716540 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53536: BlockingRecv error: recv got EOF from 127.0.0.1:53536 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:16.717638 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15446
I20260807 06:43:16.732717 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15636
I20260807 06:43:16.746268 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15837
I20260807 06:43:16.758911 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15308
2026-08-07T06:43:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2064 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[16056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[16056](info): set up 2 sockets
Aug 07 06:43:16 dist-test-slave-8hhm krb5kdc[16056](info): commencing operation
krb5kdc: starting...
W20260807 06:43:18.005898 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:18 dist-test-slave-8hhm krb5kdc[16056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:18.128101 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:41703
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:41703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:18.210964 16078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:18.211191 16078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:18.211211 16078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:18.212303 16078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:18.212338 16078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:18.212352 16078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:18.212364 16078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:18.212376 16078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:18.213907 16078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:41703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:41703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:18.214102 16078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:18.214267 16078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:18.219473 16086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:18.219538 16078 server_base.cc:1034] running on GCE node
W20260807 06:43:18.219412 16087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:18.219408 16090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:18.219897 16078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:18.220265 16078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:18.221606 16078 hybrid_clock.cc:648] HybridClock initialized: now 1786084998221571 us; error 44 us; skew 500 ppm
Aug 07 06:43:18 dist-test-slave-8hhm krb5kdc[16056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084998, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:18.224324 16078 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:18.224807 16078 webserver.cc:460] Webserver started at http://127.11.137.190:46421/ using document root <none> and password file <none>
I20260807 06:43:18.225088 16078 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:18.225176 16078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:18.225387 16078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:18.226450 16078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "d44227da71e2452994d7329f163dcefe"
format_stamp: "Formatted at 2026-08-07 06:43:18 on dist-test-slave-8hhm"
server_key: "549de8b886cdf3ec59ca512606f3c018"
server_key_iv: "535d3beabc5871451f1dbb6183055e0f"
server_key_version: "encryptionkey@0"
I20260807 06:43:18.226823 16078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "d44227da71e2452994d7329f163dcefe"
format_stamp: "Formatted at 2026-08-07 06:43:18 on dist-test-slave-8hhm"
server_key: "549de8b886cdf3ec59ca512606f3c018"
server_key_iv: "535d3beabc5871451f1dbb6183055e0f"
server_key_version: "encryptionkey@0"
I20260807 06:43:18.228148 16078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:18.228829 16097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:18.229035 16078 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:18.229142 16078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "d44227da71e2452994d7329f163dcefe"
format_stamp: "Formatted at 2026-08-07 06:43:18 on dist-test-slave-8hhm"
server_key: "549de8b886cdf3ec59ca512606f3c018"
server_key_iv: "535d3beabc5871451f1dbb6183055e0f"
server_key_version: "encryptionkey@0"
I20260807 06:43:18.229251 16078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:18.253022 16078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:18.255477 16078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:18.255656 16078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:18.259878 16078 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:41703
I20260807 06:43:18.259914 16173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:41703 every 8 connection(s)
I20260807 06:43:18.260465 16078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:18.261139 16176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:18.263520 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 16078
I20260807 06:43:18.263545 16176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe: Bootstrap starting.
I20260807 06:43:18.263636 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:18.263805 11814 external_mini_cluster.cc:1428] Setting key 7eb7c292ace7d9c673e07b0c2cd9ea32
I20260807 06:43:18.264264 16176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:18.264667 16176 log.cc:824] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:18.265513 16176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe: No bootstrap required, opened a new log
I20260807 06:43:18.267802 16176 raft_consensus.cc:348] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44227da71e2452994d7329f163dcefe" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41703 } }
I20260807 06:43:18.267974 16176 raft_consensus.cc:374] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:18.268005 16176 raft_consensus.cc:729] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44227da71e2452994d7329f163dcefe, State: Initialized, Role: FOLLOWER
I20260807 06:43:18.268124 16176 consensus_queue.cc:260] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44227da71e2452994d7329f163dcefe" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41703 } }
I20260807 06:43:18.268224 16176 raft_consensus.cc:388] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:18.268258 16176 raft_consensus.cc:482] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:18.268309 16176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:18.268939 16176 raft_consensus.cc:504] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44227da71e2452994d7329f163dcefe" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41703 } }
I20260807 06:43:18.269063 16176 leader_election.cc:302] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d44227da71e2452994d7329f163dcefe; no voters:
I20260807 06:43:18.269268 16176 leader_election.cc:288] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:18.269309 16184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:18.269523 16184 raft_consensus.cc:686] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [term 1 LEADER]: Becoming Leader. State: Replica: d44227da71e2452994d7329f163dcefe, State: Running, Role: LEADER
I20260807 06:43:18.269541 16176 sys_catalog.cc:564] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:18.269739 16184 consensus_queue.cc:237] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44227da71e2452994d7329f163dcefe" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41703 } }
I20260807 06:43:18.271039 16187 sys_catalog.cc:455] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [sys.catalog]: SysCatalogTable state changed. Reason: New leader d44227da71e2452994d7329f163dcefe. Latest consensus state: current_term: 1 leader_uuid: "d44227da71e2452994d7329f163dcefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44227da71e2452994d7329f163dcefe" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41703 } } }
Aug 07 06:43:18 dist-test-slave-8hhm krb5kdc[16056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:18.271128 16187 sys_catalog.cc:458] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:18.271217 16185 sys_catalog.cc:455] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d44227da71e2452994d7329f163dcefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44227da71e2452994d7329f163dcefe" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41703 } } }
I20260807 06:43:18.271566 16185 sys_catalog.cc:458] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe [sys.catalog]: This master's current role is: LEADER
W20260807 06:43:18.271613 16207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:43:18.271662 16207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:43:18.271842 16209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:18.272037 16209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:18.273793 16209 catalog_manager.cc:1347] Generated new cluster ID: 9be1344c2691404eac77fe62a26adab8
I20260807 06:43:18.273850 16209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:18.275861 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:18.264369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56014 (local address 127.11.137.190:41703)
0807 06:43:18.264573 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:18.264582 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:18.264608 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:43:18.265095 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:18.265102 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:18.265151 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:18.265343 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:18.266204 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:18.267116 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:18.268191 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:18.268702 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:18.268801 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:18.271823 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:18.271827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:18.271827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:18.271841 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:18.273835 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:18.274216 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:18.274219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:18.274220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:18.274331 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:18.274568 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:18.274569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:18.274570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:18.274895 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:18.275064 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:18.275554 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 06:43:18.275703 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
I20260807 06:43:18.276813 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:43:18.281618 16209 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:18.282267 16209 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:18.288940 16209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d44227da71e2452994d7329f163dcefe: Generated new TSK 0
I20260807 06:43:18.289103 16209 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:18.301704 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:18.297692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56018 (local address 127.11.137.190:41703)
0807 06:43:18.297760 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:18.297762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:18.297905 (+ 143us) server_negotiation.cc:407] Connection header received
0807 06:43:18.297991 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:18.297992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:18.298004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:18.298062 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:18.298446 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:18.299276 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:18.299969 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:18.300339 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:18.300413 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:18.301112 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:18.301113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:18.301114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:18.301432 (+ 318us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:18.301452 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:18.301460 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:18.301523 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:18.301595 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 06:43:18.301622 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:43:18.304337 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 16078
2026-08-07T06:43:18Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1544 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:18 dist-test-slave-8hhm krb5kdc[16223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:18 dist-test-slave-8hhm krb5kdc[16223](info): set up 2 sockets
Aug 07 06:43:18 dist-test-slave-8hhm krb5kdc[16223](info): commencing operation
krb5kdc: starting...
W20260807 06:43:19.608727 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:19 dist-test-slave-8hhm krb5kdc[16223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:19.732173 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39597
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:39597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:19.818058 16238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:19.818293 16238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:19.818316 16238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:19.819425 16238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:19.819463 16238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:19.819476 16238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:19.819489 16238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:19.819501 16238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:19.820952 16238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:39597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:19.821189 16238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:19.821453 16238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:19.826407 16244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:19.826522 16248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:19.826501 16245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:19.826696 16238 server_base.cc:1034] running on GCE node
I20260807 06:43:19.827011 16238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:19.827328 16238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:19.828501 16238 hybrid_clock.cc:648] HybridClock initialized: now 1786084999828486 us; error 47 us; skew 500 ppm
Aug 07 06:43:19 dist-test-slave-8hhm krb5kdc[16223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084999, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:19.831143 16238 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:19.831580 16238 webserver.cc:460] Webserver started at http://127.11.137.190:39015/ using document root <none> and password file <none>
I20260807 06:43:19.831841 16238 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:19.831912 16238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:19.832067 16238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:19.833129 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "95514efc6e7b4bf691587bb33b85e878"
format_stamp: "Formatted at 2026-08-07 06:43:19 on dist-test-slave-8hhm"
server_key: "1ed8afb7b2790b17b9951663d1e16a8f"
server_key_iv: "aa51d32f5c7407f634c916ea6c0731bc"
server_key_version: "encryptionkey@0"
I20260807 06:43:19.833559 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "95514efc6e7b4bf691587bb33b85e878"
format_stamp: "Formatted at 2026-08-07 06:43:19 on dist-test-slave-8hhm"
server_key: "1ed8afb7b2790b17b9951663d1e16a8f"
server_key_iv: "aa51d32f5c7407f634c916ea6c0731bc"
server_key_version: "encryptionkey@0"
I20260807 06:43:19.834883 16238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:19.835604 16256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:19.835795 16238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:19.835898 16238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "95514efc6e7b4bf691587bb33b85e878"
format_stamp: "Formatted at 2026-08-07 06:43:19 on dist-test-slave-8hhm"
server_key: "1ed8afb7b2790b17b9951663d1e16a8f"
server_key_iv: "aa51d32f5c7407f634c916ea6c0731bc"
server_key_version: "encryptionkey@0"
I20260807 06:43:19.835983 16238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:19.857968 16238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:19.860407 16238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:19.860610 16238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:19.864867 16238 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:39597
I20260807 06:43:19.864910 16329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:39597 every 8 connection(s)
I20260807 06:43:19.865322 16238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:19.866550 16331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:19.867493 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 16238
I20260807 06:43:19.867587 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:19.867776 11814 external_mini_cluster.cc:1428] Setting key 34f2859d9853213d93bf3c49fbcb40a5
I20260807 06:43:19.869400 16331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878: Bootstrap starting.
I20260807 06:43:19.870187 16331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:19.870510 16331 log.cc:824] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:19.871251 16331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878: No bootstrap required, opened a new log
I20260807 06:43:19.873739 16331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95514efc6e7b4bf691587bb33b85e878" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39597 } }
I20260807 06:43:19.873946 16331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:19.873991 16331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95514efc6e7b4bf691587bb33b85e878, State: Initialized, Role: FOLLOWER
I20260807 06:43:19.874120 16331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95514efc6e7b4bf691587bb33b85e878" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39597 } }
I20260807 06:43:19.874248 16331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:19.874292 16331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:19.874356 16331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 06:43:19 dist-test-slave-8hhm krb5kdc[16223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786084999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:19.874954 16331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95514efc6e7b4bf691587bb33b85e878" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39597 } }
I20260807 06:43:19.875089 16331 leader_election.cc:302] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95514efc6e7b4bf691587bb33b85e878; no voters:
I20260807 06:43:19.875299 16331 leader_election.cc:288] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:19.875334 16337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:19.875509 16337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [term 1 LEADER]: Becoming Leader. State: Replica: 95514efc6e7b4bf691587bb33b85e878, State: Running, Role: LEADER
I20260807 06:43:19.875653 16331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:19.875685 16337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95514efc6e7b4bf691587bb33b85e878" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39597 } }
I20260807 06:43:19.876123 16339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95514efc6e7b4bf691587bb33b85e878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95514efc6e7b4bf691587bb33b85e878" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39597 } } }
I20260807 06:43:19.876384 16339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:19.876299 16340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95514efc6e7b4bf691587bb33b85e878. Latest consensus state: current_term: 1 leader_uuid: "95514efc6e7b4bf691587bb33b85e878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95514efc6e7b4bf691587bb33b85e878" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39597 } } }
I20260807 06:43:19.876657 16340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:19.876935 16351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:19.877540 16351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:19.879215 16351 catalog_manager.cc:1347] Generated new cluster ID: 59d607cb83d84dc48993c0ea7c26cf02
I20260807 06:43:19.879261 16351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:19.879614 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:19.868401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49424 (local address 127.11.137.190:39597)
0807 06:43:19.868573 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:19.868580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:19.868605 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:43:19.869084 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:19.869091 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:19.869142 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:19.869333 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:19.870136 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:19.871130 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:19.872187 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:19.872595 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:19.872677 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:19.875410 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:19.875414 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:19.875414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:19.875427 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:19.877823 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:19.878204 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:19.878207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:19.878208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:19.878302 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:19.878664 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:19.878665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:19.878666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:19.878949 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:19.879117 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:19.879226 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 06:43:19.879469 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
I20260807 06:43:19.888967 16351 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:19.889568 16351 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:19.892230 16351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95514efc6e7b4bf691587bb33b85e878: Generated new TSK 0
I20260807 06:43:19.892410 16351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:19.927536 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39597
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:20.031836 16366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:20.032058 16366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:20.032083 16366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:20.033365 16366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:20.033406 16366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:20.033433 16366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:20.034878 16366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:20.035102 16366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:20.035344 16366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:20.041285 16378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:20.041294 16382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:20.041299 16379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:20.041539 16366 server_base.cc:1034] running on GCE node
I20260807 06:43:20.041772 16366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:20.041972 16366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:20.043128 16366 hybrid_clock.cc:648] HybridClock initialized: now 1786085000043118 us; error 27 us; skew 500 ppm
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:20.045846 16366 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:20.046344 16366 webserver.cc:460] Webserver started at http://127.11.137.129:44887/ using document root <none> and password file <none>
I20260807 06:43:20.046604 16366 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:20.046679 16366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:20.046838 16366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:20.048079 16366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "4ee6cd32984e41d6a4a189c8a700bd05"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "6eb01763f62703aecc2d7cd17b9d9f44"
server_key_iv: "c0d7d11f05991ad0a5b6c5c0e0cafaf7"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.048491 16366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "4ee6cd32984e41d6a4a189c8a700bd05"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "6eb01763f62703aecc2d7cd17b9d9f44"
server_key_iv: "c0d7d11f05991ad0a5b6c5c0e0cafaf7"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.050091 16366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:20.050902 16390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.051108 16366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:20.051225 16366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "4ee6cd32984e41d6a4a189c8a700bd05"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "6eb01763f62703aecc2d7cd17b9d9f44"
server_key_iv: "c0d7d11f05991ad0a5b6c5c0e0cafaf7"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.051311 16366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:20.068432 16366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:20.070586 16366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:20.070766 16366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:20.071045 16366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:20.071380 16366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:20.071437 16366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.071480 16366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:20.071511 16366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.077909 16366 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:39969
I20260807 06:43:20.077960 16551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:39969 every 8 connection(s)
I20260807 06:43:20.078299 16366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:20.083840 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 16366
I20260807 06:43:20.083927 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:20.084141 11814 external_mini_cluster.cc:1428] Setting key 449a3d49dc0d2984e60756fb51b7b56e
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:20.088384 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.079054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:54093 (local address 127.11.137.190:39597)
0807 06:43:20.079151 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:20.079153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:20.079359 (+ 206us) server_negotiation.cc:407] Connection header received
0807 06:43:20.079871 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:20.079872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:20.079882 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:20.079933 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:20.080906 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.081464 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.082461 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.082664 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.082722 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.085116 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:20.085118 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:20.085118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:20.085127 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:20.086925 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.087368 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.087370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.087370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.087435 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.087707 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.087707 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.087708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.087822 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:20.087902 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:20.088196 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 06:43:20.088291 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:43:20.088575 16557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.079017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39597 (local address 127.11.137.129:54093)
0807 06:43:20.079217 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:20.079256 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:20.079788 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:20.079998 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:20.080001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:20.080595 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:20.080807 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:20.080813 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.081552 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.081553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:20.082375 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:20.082377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.082745 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.082746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:20.082850 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.083421 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:20.083429 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:20.085027 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:20.087038 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:20.087045 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:20.087048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:20.087273 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:20.087510 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:20.087511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:20.087511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:20.087628 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:20.087893 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:20.087901 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:20.088056 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 06:43:20.088173 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 06:43:20.088327 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":112,"threads_started":1}
I20260807 06:43:20.089048 16552 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39597
I20260807 06:43:20.089131 16552 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:20.089351 16552 heartbeater.cc:511] Master 127.11.137.190:39597 requested a full tablet report, sending...
I20260807 06:43:20.089886 16280 ts_manager.cc:194] Registered new tserver with Master: 4ee6cd32984e41d6a4a189c8a700bd05 (127.11.137.129:39969)
I20260807 06:43:20.090497 16280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:54093
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:20.110508 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39597
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:20.194238 16561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:20.194475 16561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:20.194512 16561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:20.195632 16561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:20.195698 16561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:20.195739 16561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:20.197170 16561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:20.197471 16561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:20.197695 16561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:20.202704 16577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:20.202694 16573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:20.202734 16561 server_base.cc:1034] running on GCE node
W20260807 06:43:20.202673 16572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:20.203153 16561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:20.203408 16561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:20.204548 16561 hybrid_clock.cc:648] HybridClock initialized: now 1786085000204530 us; error 38 us; skew 500 ppm
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:20.207464 16561 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:20.207882 16561 webserver.cc:460] Webserver started at http://127.11.137.130:39869/ using document root <none> and password file <none>
I20260807 06:43:20.208115 16561 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:20.208160 16561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:20.208341 16561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:20.209425 16561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "e23308ad83b94dec9b60aa90565d190a"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "e7e7f5bf117c7fea81a906759489a209"
server_key_iv: "05c966bea2ff65b3b61ab445f7e77910"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.209796 16561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "e23308ad83b94dec9b60aa90565d190a"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "e7e7f5bf117c7fea81a906759489a209"
server_key_iv: "05c966bea2ff65b3b61ab445f7e77910"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.211112 16561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:20.211839 16588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.212016 16561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:20.212121 16561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "e23308ad83b94dec9b60aa90565d190a"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "e7e7f5bf117c7fea81a906759489a209"
server_key_iv: "05c966bea2ff65b3b61ab445f7e77910"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.212208 16561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:20.227531 16561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:20.229411 16561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:20.229565 16561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:20.229822 16561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:20.230139 16561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:20.230201 16561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.230245 16561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:20.230273 16561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.236289 16561 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:44041
I20260807 06:43:20.236330 16757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:44041 every 8 connection(s)
I20260807 06:43:20.236690 16561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:20.246145 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.237457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:34015 (local address 127.11.137.190:39597)
0807 06:43:20.237537 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:20.237540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:20.237728 (+ 188us) server_negotiation.cc:407] Connection header received
0807 06:43:20.238330 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:20.238335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:20.238349 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:20.238404 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:20.239427 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.239940 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.240968 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.241190 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.241311 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.243489 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:20.243490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:20.243490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:20.243498 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:20.244713 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.245113 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.245115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.245115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.245186 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.245491 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.245492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.245492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.245610 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:20.245684 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:20.245970 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 06:43:20.246055 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:43:20.246320 16761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.237413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39597 (local address 127.11.137.130:34015)
0807 06:43:20.237591 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:20.237628 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:20.238159 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:20.238464 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:20.238467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:20.239098 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:20.239289 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:20.239316 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.240055 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.240056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:20.240870 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:20.240872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.241325 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.241327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:20.241454 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.242020 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:20.242029 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:20.243386 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:20.244800 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:20.244807 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:20.244809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:20.245033 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:20.245300 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:20.245301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:20.245302 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:20.245412 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:20.245693 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:20.245701 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:20.245831 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 06:43:20.245936 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 06:43:20.246088 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260807 06:43:20.246512 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 16561
I20260807 06:43:20.246670 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:20.246922 11814 external_mini_cluster.cc:1428] Setting key cdcddf953b5655c0ab832c5fbea38823
I20260807 06:43:20.247013 16758 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39597
I20260807 06:43:20.247116 16758 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:20.247304 16758 heartbeater.cc:511] Master 127.11.137.190:39597 requested a full tablet report, sending...
I20260807 06:43:20.247824 16280 ts_manager.cc:194] Registered new tserver with Master: e23308ad83b94dec9b60aa90565d190a (127.11.137.130:44041)
I20260807 06:43:20.248356 16280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:34015
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:20.273360 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39597
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:20.355732 16767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:20.355981 16767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:20.356019 16767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:20.357159 16767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:20.357249 16767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:20.357309 16767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:20.358719 16767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:20.358975 16767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:20.359232 16767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:20.364540 16777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:20.364603 16767 server_base.cc:1034] running on GCE node
W20260807 06:43:20.364508 16785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:20.364519 16791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:20.364923 16767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:20.365195 16767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:20.366380 16767 hybrid_clock.cc:648] HybridClock initialized: now 1786085000366376 us; error 36 us; skew 500 ppm
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:20.368999 16767 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:20.369524 16767 webserver.cc:460] Webserver started at http://127.11.137.131:39693/ using document root <none> and password file <none>
I20260807 06:43:20.369776 16767 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:20.369844 16767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:20.370002 16767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:20.371078 16767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "2527e6bb98fd49b887607ef3d4b78dd4"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "0ffe19b00ea4b26181411554ddea5e93"
server_key_iv: "0f2d6b9a6bf96d95b79fdb23c8853fbb"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.371449 16767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "2527e6bb98fd49b887607ef3d4b78dd4"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "0ffe19b00ea4b26181411554ddea5e93"
server_key_iv: "0f2d6b9a6bf96d95b79fdb23c8853fbb"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.372852 16767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:20.373660 16801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.373838 16767 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.373942 16767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "2527e6bb98fd49b887607ef3d4b78dd4"
format_stamp: "Formatted at 2026-08-07 06:43:20 on dist-test-slave-8hhm"
server_key: "0ffe19b00ea4b26181411554ddea5e93"
server_key_iv: "0f2d6b9a6bf96d95b79fdb23c8853fbb"
server_key_version: "encryptionkey@0"
I20260807 06:43:20.374022 16767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:20.380858 16767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:20.382692 16767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:20.382848 16767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:20.383060 16767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:20.383379 16767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:20.383436 16767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.383476 16767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:20.383505 16767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:20.389430 16767 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:42813
I20260807 06:43:20.389479 16980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:42813 every 8 connection(s)
I20260807 06:43:20.389768 16767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:20.398770 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 16767
I20260807 06:43:20.398881 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:20.399078 11814 external_mini_cluster.cc:1428] Setting key 25d4339a248e984bab6b3f7ef7c074b9
I20260807 06:43:20.399537 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.390478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:57067 (local address 127.11.137.190:39597)
0807 06:43:20.390545 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:20.390547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:20.390725 (+ 178us) server_negotiation.cc:407] Connection header received
0807 06:43:20.391192 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:20.391193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:20.391203 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:20.391260 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:20.392189 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.392947 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.394052 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.394264 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.394356 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.396481 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:20.396483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:20.396483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:20.396490 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:20.397923 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.398341 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.398342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.398343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.398406 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.398660 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.398661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.398662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.398779 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:20.398853 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:20.399320 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 06:43:20.399413 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:43:20.399783 16986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.390446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39597 (local address 127.11.137.131:57067)
0807 06:43:20.390598 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:20.390638 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:20.391114 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:20.391312 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:20.391315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:20.391899 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:20.392087 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:20.392091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.393047 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.393048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:20.393932 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:20.393934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.394368 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.394369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:20.394489 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.394924 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:20.394932 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:20.396356 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:20.398007 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:20.398013 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:20.398016 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:20.398261 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:20.398484 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:20.398485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:20.398485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:20.398594 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:20.398855 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:20.398863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:20.399071 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 06:43:20.399266 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 06:43:20.399469 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260807 06:43:20.400344 16983 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39597
I20260807 06:43:20.400425 16983 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:20.400573 16983 heartbeater.cc:511] Master 127.11.137.190:39597 requested a full tablet report, sending...
I20260807 06:43:20.400944 16279 ts_manager.cc:194] Registered new tserver with Master: 2527e6bb98fd49b887607ef3d4b78dd4 (127.11.137.131:42813)
I20260807 06:43:20.401438 16279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:57067
I20260807 06:43:20.411348 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085000, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:20.436784 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:20.429657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49440 (local address 127.11.137.190:39597)
0807 06:43:20.429721 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:20.429723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:20.429879 (+ 156us) server_negotiation.cc:407] Connection header received
0807 06:43:20.429969 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:20.429970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:20.429981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:20.430057 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:20.430685 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.431197 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.431946 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:20.432150 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:20.432227 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:20.434600 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:20.434602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:20.434602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:20.434609 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:20.435786 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.436085 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.436086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.436086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.436139 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:20.436305 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:20.436305 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:20.436306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:20.436446 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:20.436524 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:20.436614 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 06:43:20.436674 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 06:43:20.437071 16279 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49440
I20260807 06:43:20.437808 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 16366
I20260807 06:43:20.450047 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 16561
I20260807 06:43:20.460225 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 16767
I20260807 06:43:20.468791 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 16238
2026-08-07T06:43:20Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2166 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16999](info): set up 2 sockets
Aug 07 06:43:20 dist-test-slave-8hhm krb5kdc[16999](info): commencing operation
krb5kdc: starting...
W20260807 06:43:21.727317 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:21 dist-test-slave-8hhm krb5kdc[16999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:21.852119 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:33515
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:33515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:21.933971 17021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:21.934173 17021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:21.934195 17021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:21.935397 17021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:21.935448 17021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:21.935463 17021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:21.935483 17021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:21.935495 17021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:21.937000 17021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:33515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:33515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:21.937290 17021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:21.937521 17021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:21.942633 17031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:21.942749 17021 server_base.cc:1034] running on GCE node
W20260807 06:43:21.942619 17034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:21.942636 17032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:21.943153 17021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:21.943408 17021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:21.944574 17021 hybrid_clock.cc:648] HybridClock initialized: now 1786085001944571 us; error 36 us; skew 500 ppm
Aug 07 06:43:21 dist-test-slave-8hhm krb5kdc[16999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085001, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:21.952593 17021 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:21.953094 17021 webserver.cc:460] Webserver started at http://127.11.137.190:37773/ using document root <none> and password file <none>
I20260807 06:43:21.953380 17021 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:21.953452 17021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:21.953608 17021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:21.954655 17021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "2cb8ac77b8b74ba08fb66c01de1269fa"
format_stamp: "Formatted at 2026-08-07 06:43:21 on dist-test-slave-8hhm"
server_key: "b1ea09eba3d67cf2e5ea8d704d830d56"
server_key_iv: "f273a28ed4cfcd56e680e3537ad56418"
server_key_version: "encryptionkey@0"
I20260807 06:43:21.955045 17021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "2cb8ac77b8b74ba08fb66c01de1269fa"
format_stamp: "Formatted at 2026-08-07 06:43:21 on dist-test-slave-8hhm"
server_key: "b1ea09eba3d67cf2e5ea8d704d830d56"
server_key_iv: "f273a28ed4cfcd56e680e3537ad56418"
server_key_version: "encryptionkey@0"
I20260807 06:43:21.956404 17021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:21.957141 17044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:21.957336 17021 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:21.957443 17021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "2cb8ac77b8b74ba08fb66c01de1269fa"
format_stamp: "Formatted at 2026-08-07 06:43:21 on dist-test-slave-8hhm"
server_key: "b1ea09eba3d67cf2e5ea8d704d830d56"
server_key_iv: "f273a28ed4cfcd56e680e3537ad56418"
server_key_version: "encryptionkey@0"
I20260807 06:43:21.957531 17021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:21.972988 17021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:21.975114 17021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:21.975291 17021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:21.979768 17021 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:33515
I20260807 06:43:21.979806 17125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:33515 every 8 connection(s)
I20260807 06:43:21.980314 17021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:21.981019 17127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:21.983407 17127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa: Bootstrap starting.
I20260807 06:43:21.984016 17127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:21.984336 17127 log.cc:824] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:21.985062 17127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa: No bootstrap required, opened a new log
I20260807 06:43:21.986702 17127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 33515 } }
I20260807 06:43:21.986841 17127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:21.986888 17127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb8ac77b8b74ba08fb66c01de1269fa, State: Initialized, Role: FOLLOWER
I20260807 06:43:21.987041 17127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 33515 } }
I20260807 06:43:21.987140 17127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:21.987221 17127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:21.987265 17127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:21.987389 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 17021
I20260807 06:43:21.987499 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:21.987689 11814 external_mini_cluster.cc:1428] Setting key 9bc023c189fc56d8cfc0a75a67a9277c
I20260807 06:43:21.988631 17127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 33515 } }
I20260807 06:43:21.988740 17127 leader_election.cc:302] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cb8ac77b8b74ba08fb66c01de1269fa; no voters:
I20260807 06:43:21.988910 17127 leader_election.cc:288] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:21.988967 17132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:21.989164 17127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:21.989192 17132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [term 1 LEADER]: Becoming Leader. State: Replica: 2cb8ac77b8b74ba08fb66c01de1269fa, State: Running, Role: LEADER
I20260807 06:43:21.989475 17132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 33515 } }
I20260807 06:43:21.989889 17134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 33515 } } }
I20260807 06:43:21.989979 17134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:21.991176 17135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cb8ac77b8b74ba08fb66c01de1269fa. Latest consensus state: current_term: 1 leader_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb8ac77b8b74ba08fb66c01de1269fa" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 33515 } } }
I20260807 06:43:21.991261 17135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:21.991328 17145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:21.991927 17145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:21.993688 17145 catalog_manager.cc:1347] Generated new cluster ID: 333e5dfe96cd42afa373d7ea8fefec33
I20260807 06:43:21.993750 17145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:43:21 dist-test-slave-8hhm krb5kdc[16999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:21.999518 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:21.988235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43714 (local address 127.11.137.190:33515)
0807 06:43:21.988428 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:21.988438 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:21.988479 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:43:21.988616 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:21.988625 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:21.988680 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:21.988828 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:21.989728 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:21.991229 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:21.992280 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:21.992822 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:21.992956 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:21.995891 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:21.995895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:21.995896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:21.995907 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:21.997913 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:21.998320 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:21.998322 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:21.998323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:21.998435 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:21.998674 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:21.998675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:21.998675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:21.998944 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:21.999094 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:21.999216 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 06:43:21.999337 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260807 06:43:22.007117 17145 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:22.007829 17145 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:22.013410 17145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cb8ac77b8b74ba08fb66c01de1269fa: Generated new TSK 0
I20260807 06:43:22.013597 17145 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:22.047664 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:33515
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:22.130264 17164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:22.130496 17164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:22.130534 17164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:22.131662 17164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:22.131754 17164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:22.131801 17164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:22.133460 17164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:33515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:22.133733 17164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:22.133960 17164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:22.138877 17175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:22.138949 17171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:22.138883 17169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:22.139114 17164 server_base.cc:1034] running on GCE node
I20260807 06:43:22.139547 17164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:22.139739 17164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:22.140878 17164 hybrid_clock.cc:648] HybridClock initialized: now 1786085002140865 us; error 28 us; skew 500 ppm
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:22.143465 17164 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:22.143926 17164 webserver.cc:460] Webserver started at http://127.11.137.129:43661/ using document root <none> and password file <none>
I20260807 06:43:22.144167 17164 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:22.144237 17164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:22.144388 17164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:22.145476 17164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "a995dcec5e5d48a6bc8f37adda9848f4"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "edce67af4a92e0c7c707da220cd4a3fd"
server_key_iv: "e5e25ffa3e8c170d9df669d959fcb60e"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.145824 17164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "a995dcec5e5d48a6bc8f37adda9848f4"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "edce67af4a92e0c7c707da220cd4a3fd"
server_key_iv: "e5e25ffa3e8c170d9df669d959fcb60e"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.147153 17164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:22.147970 17187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.148155 17164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:22.148276 17164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "a995dcec5e5d48a6bc8f37adda9848f4"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "edce67af4a92e0c7c707da220cd4a3fd"
server_key_iv: "e5e25ffa3e8c170d9df669d959fcb60e"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.148367 17164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:22.163012 17164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:22.165004 17164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:22.165205 17164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:22.165539 17164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:22.165899 17164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:22.165980 17164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.166056 17164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:22.166095 17164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.173199 17164 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:34153
I20260807 06:43:22.173255 17369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:34153 every 8 connection(s)
I20260807 06:43:22.173673 17164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:22.182888 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 17164
I20260807 06:43:22.182969 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:22.183173 11814 external_mini_cluster.cc:1428] Setting key c7e44d8560b8caeded2df00826fe89d7
I20260807 06:43:22.183809 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.174469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:39911 (local address 127.11.137.190:33515)
0807 06:43:22.174577 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:22.174579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:22.174778 (+ 199us) server_negotiation.cc:407] Connection header received
0807 06:43:22.175895 (+ 1117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:22.175897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:22.175913 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:22.175985 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:22.176675 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.177318 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.178426 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.178672 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.178771 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.181006 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:22.181008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:22.181008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:22.181018 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:22.182335 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.182758 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.182759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.182759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.182821 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.183087 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.183088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.183089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.183208 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:22.183292 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:22.183626 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 06:43:22.183709 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:43:22.183979 17373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.174440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:33515 (local address 127.11.137.129:39911)
0807 06:43:22.174636 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:22.174684 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:22.175763 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:22.176059 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:22.176063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:22.176354 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:22.176556 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:22.176561 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.177446 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.177447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:22.178302 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:22.178305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.178785 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.178786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:22.178923 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.179552 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:22.179560 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:22.180903 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:22.182436 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:22.182444 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:22.182446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:22.182665 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:22.182889 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:22.182890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:22.182890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:22.183028 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:22.183283 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:22.183291 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:22.183453 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 06:43:22.183587 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 06:43:22.183747 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
I20260807 06:43:22.184516 17371 heartbeater.cc:347] Connected to a master server at 127.11.137.190:33515
I20260807 06:43:22.184620 17371 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:22.184806 17371 heartbeater.cc:511] Master 127.11.137.190:33515 requested a full tablet report, sending...
I20260807 06:43:22.185467 17075 ts_manager.cc:194] Registered new tserver with Master: a995dcec5e5d48a6bc8f37adda9848f4 (127.11.137.129:34153)
I20260807 06:43:22.186174 17075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:39911
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:22.210094 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:33515
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:22.292877 17378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:22.293084 17378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:22.293108 17378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:22.294201 17378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:22.294239 17378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:22.294265 17378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:22.295688 17378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:33515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:22.295863 17378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:22.296039 17378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:22.300976 17389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:22.301014 17378 server_base.cc:1034] running on GCE node
W20260807 06:43:22.301059 17388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:22.300995 17393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:22.301492 17378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:22.301745 17378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:22.302887 17378 hybrid_clock.cc:648] HybridClock initialized: now 1786085002302864 us; error 39 us; skew 500 ppm
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:22.305406 17378 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:22.305883 17378 webserver.cc:460] Webserver started at http://127.11.137.130:33069/ using document root <none> and password file <none>
I20260807 06:43:22.306118 17378 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:22.306188 17378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:22.306342 17378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:22.307358 17378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "eb5b8e780c2d48bebdcf7c7874232f42"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "39402678e1971376cc8370ae8186a4d2"
server_key_iv: "e4c065287eaec5cb99e799300f54121e"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.307736 17378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "eb5b8e780c2d48bebdcf7c7874232f42"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "39402678e1971376cc8370ae8186a4d2"
server_key_iv: "e4c065287eaec5cb99e799300f54121e"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.309099 17378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:22.309883 17401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.310058 17378 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:22.310169 17378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "eb5b8e780c2d48bebdcf7c7874232f42"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "39402678e1971376cc8370ae8186a4d2"
server_key_iv: "e4c065287eaec5cb99e799300f54121e"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.310243 17378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:22.336164 17378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:22.338189 17378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:22.338351 17378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:22.338584 17378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:22.338894 17378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:22.338956 17378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.338999 17378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:22.339026 17378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.344831 17378 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:39213
I20260807 06:43:22.344877 17585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:39213 every 8 connection(s)
I20260807 06:43:22.345202 17378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:22.354059 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.346005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49103 (local address 127.11.137.190:33515)
0807 06:43:22.346090 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:22.346093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:22.346260 (+ 167us) server_negotiation.cc:407] Connection header received
0807 06:43:22.347136 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:22.347137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:22.347147 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:22.347200 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:22.347747 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.348220 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.349158 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.349412 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.349466 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.351532 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:22.351533 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:22.351534 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:22.351540 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:22.352778 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.353140 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.353141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.353141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.353193 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.353529 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.353530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.353530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.353637 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:22.353691 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:22.353923 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 06:43:22.353996 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:43:22.354199 17589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.345961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:33515 (local address 127.11.137.130:49103)
0807 06:43:22.346139 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:22.346174 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:22.347036 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:22.347266 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:22.347269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:22.347502 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:22.347678 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:22.347683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.348326 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.348327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:22.349084 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:22.349086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.349483 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.349484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:22.349581 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.350070 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:22.350077 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:22.351431 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:22.352847 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:22.352854 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:22.352855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:22.353074 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:22.353333 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:22.353333 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:22.353334 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:22.353462 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:22.353698 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:22.353703 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:22.353810 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 06:43:22.353894 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:43:22.354008 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260807 06:43:22.354701 17587 heartbeater.cc:347] Connected to a master server at 127.11.137.190:33515
I20260807 06:43:22.354804 17587 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:22.354887 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 17378
I20260807 06:43:22.354998 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:22.355005 17587 heartbeater.cc:511] Master 127.11.137.190:33515 requested a full tablet report, sending...
I20260807 06:43:22.355181 11814 external_mini_cluster.cc:1428] Setting key 136a0c52cbbd395ce6a95a84abac8ef8
I20260807 06:43:22.355419 17075 ts_manager.cc:194] Registered new tserver with Master: eb5b8e780c2d48bebdcf7c7874232f42 (127.11.137.130:39213)
I20260807 06:43:22.356030 17075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:49103
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:22.380108 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:33515
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:22.462177 17594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:22.462378 17594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:22.462400 17594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:22.463526 17594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:22.463565 17594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:22.463626 17594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:22.465144 17594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:33515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:22.465426 17594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:22.465652 17594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:22.470811 17599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:22.470806 17602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:22.470789 17600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:22.470870 17594 server_base.cc:1034] running on GCE node
I20260807 06:43:22.471253 17594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:22.471488 17594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:22.472642 17594 hybrid_clock.cc:648] HybridClock initialized: now 1786085002472630 us; error 24 us; skew 500 ppm
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:22.475222 17594 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:22.475692 17594 webserver.cc:460] Webserver started at http://127.11.137.131:40641/ using document root <none> and password file <none>
I20260807 06:43:22.475921 17594 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:22.475998 17594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:22.476152 17594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:22.477169 17594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "dd58614076454a5886f9b6422b704e60"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "1eb05536718ed071c7e44390b05e6601"
server_key_iv: "f057a396c561ad2fc1196834328aea95"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.477612 17594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "dd58614076454a5886f9b6422b704e60"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "1eb05536718ed071c7e44390b05e6601"
server_key_iv: "f057a396c561ad2fc1196834328aea95"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.478931 17594 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:22.479705 17611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.479910 17594 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:22.480034 17594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "dd58614076454a5886f9b6422b704e60"
format_stamp: "Formatted at 2026-08-07 06:43:22 on dist-test-slave-8hhm"
server_key: "1eb05536718ed071c7e44390b05e6601"
server_key_iv: "f057a396c561ad2fc1196834328aea95"
server_key_version: "encryptionkey@0"
I20260807 06:43:22.480115 17594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:22.488293 17594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:22.490449 17594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:22.490625 17594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:22.490859 17594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:22.491173 17594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:22.491227 17594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.491266 17594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:22.491292 17594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:22.497474 17594 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:38657
I20260807 06:43:22.497541 17786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:38657 every 8 connection(s)
I20260807 06:43:22.497838 17594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:22.505000 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 17594
I20260807 06:43:22.505117 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:22.505337 11814 external_mini_cluster.cc:1428] Setting key 349a7f1c5ba4fa5bedce69ba9a744c2b
I20260807 06:43:22.507226 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.498484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:47119 (local address 127.11.137.190:33515)
0807 06:43:22.498534 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:22.498535 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:22.498749 (+ 214us) server_negotiation.cc:407] Connection header received
0807 06:43:22.499689 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:22.499691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:22.499704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:22.499760 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:22.500353 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.500834 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.501863 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.502053 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.502125 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.504147 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:22.504148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:22.504149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:22.504157 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:22.505612 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.506137 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.506139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.506139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.506240 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.506535 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.506536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.506536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.506677 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:22.506767 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:22.507058 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:43:22.507135 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:43:22.507448 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.498464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:33515 (local address 127.11.137.131:47119)
0807 06:43:22.498634 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:22.498667 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:22.499581 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:22.499825 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:22.499829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:22.500081 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:22.500252 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:22.500257 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.500931 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.500932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:22.501771 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:22.501774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.502145 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.502146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:22.502262 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.502694 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:22.502702 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:22.504043 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:22.505700 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:22.505707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:22.505709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:22.506027 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:22.506303 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:22.506304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:22.506304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:22.506422 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:22.506758 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:22.506766 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:22.506927 (+ 161us) client_negotiation.cc:769] Sending connection context
0807 06:43:22.507033 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:43:22.507193 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260807 06:43:22.507884 17787 heartbeater.cc:347] Connected to a master server at 127.11.137.190:33515
I20260807 06:43:22.507990 17787 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:22.508152 17787 heartbeater.cc:511] Master 127.11.137.190:33515 requested a full tablet report, sending...
I20260807 06:43:22.508497 17075 ts_manager.cc:194] Registered new tserver with Master: dd58614076454a5886f9b6422b704e60 (127.11.137.131:38657)
I20260807 06:43:22.508821 17075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:47119
I20260807 06:43:22.517416 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:22.540820 17799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.533435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36290 (local address 127.11.137.129:34153)
0807 06:43:22.533621 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:22.533626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:22.533637 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:43:22.533663 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:22.533665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:22.533679 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:22.533746 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:22.534289 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.534975 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.535699 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.536041 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.536114 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.538347 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:22.538356 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:22.538356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:22.538363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:22.539783 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.540107 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.540109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.540109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.540166 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.540341 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.540341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.540342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.540470 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:22.540572 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:22.540640 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 06:43:22.540702 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":96,"threads_started":1}
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[16999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:22.548377 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:22.542152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43728 (local address 127.11.137.190:33515)
0807 06:43:22.542196 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:22.542198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:22.542207 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:22.542264 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:22.542265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:22.542274 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:22.542317 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:22.542738 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.543209 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.543841 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:22.544011 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:22.544059 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:22.546164 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:22.546165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:22.546166 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:22.546172 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:22.547527 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.547804 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.547805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.547805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.547854 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:22.547995 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:22.547995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:22.547995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:22.548116 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:22.548186 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:22.548260 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 06:43:22.548316 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:43:22.548647 17075 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43728
I20260807 06:43:22.549060 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 17164
I20260807 06:43:22.558386 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 17378
I20260807 06:43:22.574988 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 17594
I20260807 06:43:22.593106 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 17021
2026-08-07T06:43:22Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2120 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[17805](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[17805](info): set up 2 sockets
Aug 07 06:43:22 dist-test-slave-8hhm krb5kdc[17805](info): commencing operation
krb5kdc: starting...
W20260807 06:43:23.843930 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:23 dist-test-slave-8hhm krb5kdc[17805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:23.979959 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:41851
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:41851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:24.063429 17823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:24.063644 17823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:24.063668 17823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:24.064845 17823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:24.064888 17823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:24.064901 17823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:24.064914 17823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:24.064973 17823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:24.066433 17823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:41851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:41851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:24.066680 17823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:24.066917 17823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:24.071851 17844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.071871 17835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.071846 17834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:24.072142 17823 server_base.cc:1034] running on GCE node
I20260807 06:43:24.072396 17823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:24.072649 17823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:24.073832 17823 hybrid_clock.cc:648] HybridClock initialized: now 1786085004073814 us; error 35 us; skew 500 ppm
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:24.076453 17823 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:24.076917 17823 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:24.076984 17823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:24.077181 17823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:24.078430 17823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "5afd0ee4fbcf457e9994cb7d03b2466d"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "0bb857bb8ada180039f4d79222284bd7"
server_key_iv: "ca5ebbbfb574c2c9d4ca946f53683325"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.078845 17823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "5afd0ee4fbcf457e9994cb7d03b2466d"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "0bb857bb8ada180039f4d79222284bd7"
server_key_iv: "ca5ebbbfb574c2c9d4ca946f53683325"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.080281 17823 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:24.081084 17852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.081316 17823 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:24.081430 17823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "5afd0ee4fbcf457e9994cb7d03b2466d"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "0bb857bb8ada180039f4d79222284bd7"
server_key_iv: "ca5ebbbfb574c2c9d4ca946f53683325"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.081538 17823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:24.091048 17823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:24.092882 17823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:24.093063 17823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:24.097740 17823 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:41851
I20260807 06:43:24.097761 17938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:41851 every 8 connection(s)
I20260807 06:43:24.098068 17823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:24.099095 17939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:24.101325 17939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d: Bootstrap starting.
I20260807 06:43:24.102018 17939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:24.102311 17939 log.cc:824] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:24.103014 17939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d: No bootstrap required, opened a new log
I20260807 06:43:24.104597 17939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41851 } }
I20260807 06:43:24.104776 17939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:24.104823 17939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5afd0ee4fbcf457e9994cb7d03b2466d, State: Initialized, Role: FOLLOWER
I20260807 06:43:24.104871 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 17823
I20260807 06:43:24.104998 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:24.104979 17939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41851 } }
I20260807 06:43:24.105054 17939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:24.105087 17939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:24.105139 17939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:24.105235 11814 external_mini_cluster.cc:1428] Setting key 21927d91a0f0322a13defdb8080261fd
I20260807 06:43:24.106190 17939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41851 } }
I20260807 06:43:24.106323 17939 leader_election.cc:302] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5afd0ee4fbcf457e9994cb7d03b2466d; no voters:
I20260807 06:43:24.106504 17939 leader_election.cc:288] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:24.106527 17947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:24.106715 17947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [term 1 LEADER]: Becoming Leader. State: Replica: 5afd0ee4fbcf457e9994cb7d03b2466d, State: Running, Role: LEADER
I20260807 06:43:24.106771 17939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:24.106802 17947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41851 } }
I20260807 06:43:24.107225 17950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5afd0ee4fbcf457e9994cb7d03b2466d. Latest consensus state: current_term: 1 leader_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41851 } } }
I20260807 06:43:24.107239 17948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afd0ee4fbcf457e9994cb7d03b2466d" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41851 } } }
I20260807 06:43:24.107403 17950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:24.107419 17948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:24.107793 17960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:24.108300 17960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:24.109889 17960 catalog_manager.cc:1347] Generated new cluster ID: 57cee5eba2b24b1dbb1858c4272321a5
I20260807 06:43:24.109946 17960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:24.116338 17960 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:24.116977 17960 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:24.118841 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.105773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43480 (local address 127.11.137.190:41851)
0807 06:43:24.105962 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.105977 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.106004 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:43:24.106097 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.106103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.106141 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.106246 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:24.107109 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.108655 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.109620 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.110193 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.110309 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.115411 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:24.115415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:24.115416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:24.115427 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:24.117283 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.117664 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.117667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.117668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.117764 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.117992 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.117993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.117994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.118213 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:24.118389 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.118483 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.118634 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
I20260807 06:43:24.132292 17960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d: Generated new TSK 0
I20260807 06:43:24.132503 17960 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:24.164112 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:41851
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:24.258423 17979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:24.258662 17979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:24.258704 17979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:24.259923 17979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:24.259989 17979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:24.260047 17979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:24.261660 17979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:41851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:24.261917 17979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:24.262158 17979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:24.267356 17992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.267344 17991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.267359 17996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:24.267644 17979 server_base.cc:1034] running on GCE node
I20260807 06:43:24.267854 17979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:24.268054 17979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:24.269273 17979 hybrid_clock.cc:648] HybridClock initialized: now 1786085004269254 us; error 26 us; skew 500 ppm
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:24.271791 17979 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:24.272121 17979 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:24.272171 17979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:24.272333 17979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:24.273468 17979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "f7dbcd62baa345cdb672b3e52ef6d458"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "1f23647a94d3f7fecd451b693c3b8610"
server_key_iv: "d12e6759134f839fd521713076a888bc"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.273845 17979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "f7dbcd62baa345cdb672b3e52ef6d458"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "1f23647a94d3f7fecd451b693c3b8610"
server_key_iv: "d12e6759134f839fd521713076a888bc"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.275154 17979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:24.276041 18005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.276310 17979 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:24.276417 17979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "f7dbcd62baa345cdb672b3e52ef6d458"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "1f23647a94d3f7fecd451b693c3b8610"
server_key_iv: "d12e6759134f839fd521713076a888bc"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.276515 17979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:24.298623 17979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:24.300909 17979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:24.301060 17979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:24.301362 17979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:24.301707 17979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:24.301743 17979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.301767 17979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:24.301779 17979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.308068 17979 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:45341
I20260807 06:43:24.308149 18201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:45341 every 8 connection(s)
I20260807 06:43:24.308426 17979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:24.309840 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 17979
I20260807 06:43:24.309963 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:24.310151 11814 external_mini_cluster.cc:1428] Setting key 35094e50bef9ddd4e76f31431611ac3a
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:24.319325 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.309248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:45125 (local address 127.11.137.190:41851)
0807 06:43:24.309299 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.309301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.309536 (+ 235us) server_negotiation.cc:407] Connection header received
0807 06:43:24.310273 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.310275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.310287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.310372 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:24.311722 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.312208 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.313428 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.313765 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.313840 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.316311 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:24.316312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:24.316312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:24.316319 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:24.317831 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.318314 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.318315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.318316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.318373 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.318684 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.318685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.318685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.318792 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:24.318844 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.319188 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.319260 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:43:24.319614 18204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.309182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:41851 (local address 127.11.137.129:45125)
0807 06:43:24.309398 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.309443 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.310150 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.310474 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.310479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.310856 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:24.311604 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.311612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.312302 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.312303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.313348 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.313350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.313859 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.313859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.313960 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.314511 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:24.314519 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:24.316200 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:24.317922 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:24.317931 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:24.317934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:24.318228 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:24.318445 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:24.318445 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:24.318446 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:24.318614 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:24.318860 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:24.318868 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:24.319036 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.319165 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.319334 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":117,"threads_started":1}
I20260807 06:43:24.320251 18202 heartbeater.cc:347] Connected to a master server at 127.11.137.190:41851
I20260807 06:43:24.320351 18202 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:43:24.320523 18202 heartbeater.cc:511] Master 127.11.137.190:41851 requested a full tablet report, sending...
I20260807 06:43:24.321117 17877 ts_manager.cc:194] Registered new tserver with Master: f7dbcd62baa345cdb672b3e52ef6d458 (127.11.137.129:45341)
I20260807 06:43:24.321780 17877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:45125
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:24.340768 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:41851
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:24.428361 18208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:24.428561 18208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:24.428584 18208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:24.429739 18208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:24.429785 18208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:24.429809 18208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:24.431300 18208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:41851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:24.431571 18208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:24.431835 18208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:24.437036 18222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.437062 18218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.437085 18215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:24.437322 18208 server_base.cc:1034] running on GCE node
I20260807 06:43:24.437563 18208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:24.437839 18208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:24.439011 18208 hybrid_clock.cc:648] HybridClock initialized: now 1786085004439014 us; error 45 us; skew 500 ppm
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:24.441685 18208 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:24.442078 18208 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:24.442148 18208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:24.442293 18208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:24.443629 18208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "c3cb721d8a49459c92cf9de9b74b5970"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "38d21b0dc9a0f12d8e77da62252156d9"
server_key_iv: "703ba64840d171b61368702da8671652"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.444092 18208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "c3cb721d8a49459c92cf9de9b74b5970"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "38d21b0dc9a0f12d8e77da62252156d9"
server_key_iv: "703ba64840d171b61368702da8671652"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.445415 18208 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260807 06:43:24.446113 18232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.446308 18208 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.446406 18208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "c3cb721d8a49459c92cf9de9b74b5970"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "38d21b0dc9a0f12d8e77da62252156d9"
server_key_iv: "703ba64840d171b61368702da8671652"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.446483 18208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:24.462229 18208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:24.464540 18208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:24.464684 18208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:24.464933 18208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:24.465391 18208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:24.465448 18208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.465492 18208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:24.465519 18208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.471619 18208 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:45691
I20260807 06:43:24.471653 18411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:45691 every 8 connection(s)
I20260807 06:43:24.471951 18208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:24.476836 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 18208
I20260807 06:43:24.476974 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:24.477180 11814 external_mini_cluster.cc:1428] Setting key 12f83127e38adb07a45df0480f0b7cf3
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:24.481946 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.472707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:57553 (local address 127.11.137.190:41851)
0807 06:43:24.472768 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.472770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.472958 (+ 188us) server_negotiation.cc:407] Connection header received
0807 06:43:24.473560 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.473562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.473574 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.473641 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:24.474546 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.475026 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.476008 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.476241 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.476305 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.478748 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:24.478749 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:24.478749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:24.478757 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:24.480529 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.480911 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.480912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.480913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.480982 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.481246 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.481247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.481248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.481398 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:24.481485 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.481770 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.481853 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 06:43:24.482141 18415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.472649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:41851 (local address 127.11.137.130:57553)
0807 06:43:24.472818 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.472860 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.473434 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.473727 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.473730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.473975 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:24.474464 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.474469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.475128 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.475129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.475912 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.475914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.476324 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.476325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.476424 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.476919 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:24.476927 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:24.478647 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:24.480607 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:24.480614 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:24.480615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:24.480832 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:24.481053 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:24.481053 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:24.481054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:24.481150 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:24.481477 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:24.481486 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:24.481632 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.481748 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.481905 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260807 06:43:24.482652 18412 heartbeater.cc:347] Connected to a master server at 127.11.137.190:41851
I20260807 06:43:24.482766 18412 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:24.482919 18412 heartbeater.cc:511] Master 127.11.137.190:41851 requested a full tablet report, sending...
I20260807 06:43:24.483338 17877 ts_manager.cc:194] Registered new tserver with Master: c3cb721d8a49459c92cf9de9b74b5970 (127.11.137.130:45691)
I20260807 06:43:24.483906 17877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:57553
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:24.505632 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:41851
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:24.587872 18420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:24.588083 18420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:24.588106 18420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:24.589206 18420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:24.589260 18420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:24.589288 18420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:24.590817 18420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:41851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:24.591002 18420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:24.591174 18420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:24.596326 18434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.596338 18428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.596359 18431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:24.596613 18420 server_base.cc:1034] running on GCE node
I20260807 06:43:24.596803 18420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:24.597002 18420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:24.598145 18420 hybrid_clock.cc:648] HybridClock initialized: now 1786085004598112 us; error 46 us; skew 500 ppm
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:24.600585 18420 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:24.600878 18420 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:24.600921 18420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:24.601011 18420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:24.602106 18420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "bce773357fa14eb7971093cc1d03c4b9"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "8340c8bd60558fde49bcf5cc1fa7ce32"
server_key_iv: "07c67cd03865eae3fbcd923d94a3b897"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.602429 18420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "bce773357fa14eb7971093cc1d03c4b9"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "8340c8bd60558fde49bcf5cc1fa7ce32"
server_key_iv: "07c67cd03865eae3fbcd923d94a3b897"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.603778 18420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:43:24.604506 18444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.604660 18420 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:24.604755 18420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "bce773357fa14eb7971093cc1d03c4b9"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "8340c8bd60558fde49bcf5cc1fa7ce32"
server_key_iv: "07c67cd03865eae3fbcd923d94a3b897"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.604810 18420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:24.626822 18420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:24.629160 18420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:24.629341 18420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:24.629598 18420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:24.629953 18420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:24.629989 18420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.630033 18420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:24.630064 18420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.636145 18420 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:45799
I20260807 06:43:24.636245 18634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:45799 every 8 connection(s)
I20260807 06:43:24.636489 18420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:24.641150 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 18420
I20260807 06:43:24.641286 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:24.641474 11814 external_mini_cluster.cc:1428] Setting key a96ae2974a7fa5f46396dfe6358de418
Aug 07 06:43:24 dist-test-slave-8hhm krb5kdc[17805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085004, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:24.645896 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.637322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:39247 (local address 127.11.137.190:41851)
0807 06:43:24.637386 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.637388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.637607 (+ 219us) server_negotiation.cc:407] Connection header received
0807 06:43:24.638084 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.638085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.638096 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.638151 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:24.639048 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.639536 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.640502 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.640692 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.640749 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.643164 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:24.643166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:24.643166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:24.643174 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:24.644439 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.644868 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.644870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.644870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.644938 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.645200 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.645201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.645202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.645350 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:24.645426 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.645722 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.645808 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:43:24.646080 18640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.637340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:41851 (local address 127.11.137.131:39247)
0807 06:43:24.637502 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.637538 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.637998 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.638223 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.638226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.638474 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:24.638968 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.638974 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.639615 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.639616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.640406 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.640408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.640771 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.640771 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.640870 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.641390 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:24.641400 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:24.643066 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:24.644547 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:24.644555 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:24.644557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:24.644786 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:24.645017 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:24.645018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:24.645018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:24.645130 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:24.645430 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:24.645438 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:24.645579 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.645684 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.645839 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260807 06:43:24.646574 18637 heartbeater.cc:347] Connected to a master server at 127.11.137.190:41851
I20260807 06:43:24.646674 18637 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:24.646827 18637 heartbeater.cc:511] Master 127.11.137.190:41851 requested a full tablet report, sending...
I20260807 06:43:24.647208 17877 ts_manager.cc:194] Registered new tserver with Master: bce773357fa14eb7971093cc1d03c4b9 (127.11.137.131:45799)
I20260807 06:43:24.647560 17877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:39247
I20260807 06:43:24.653056 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:24.660239 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.654366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.11.137.190:41851)
0807 06:43:24.654449 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.654451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.654578 (+ 127us) server_negotiation.cc:407] Connection header received
0807 06:43:24.654666 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.654667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.654678 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.654727 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:24.655262 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.655732 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.656489 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.656693 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.656767 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.657901 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:24.657903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:24.657903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:24.657910 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:24.659063 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.659409 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.659410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.659411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.659467 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:24.659684 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:24.659685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:24.659685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:24.659831 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:24.659936 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.660064 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.660140 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:43:24.661762 17877 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:24.663250 17877 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:24.669922 18655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.665765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45691 (local address 127.0.0.1:50502)
0807 06:43:24.666143 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.666152 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.666221 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.666560 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.666561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.666563 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:24.666594 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.666595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.667796 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.667797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.668810 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.668813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.669578 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.669579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.669657 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.669670 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.669773 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.669825 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":72,"threads_started":1}
I20260807 06:43:24.670025 18654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.665531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:45799 (local address 127.0.0.1:48746)
0807 06:43:24.665698 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.665737 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.665808 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.666086 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.666089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.666092 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:24.666161 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.666163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.667579 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.667579 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.668822 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.668825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.669796 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.669797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.669874 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.669880 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.669913 (+ 33us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.669953 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":44,"thread_start_us":78,"threads_started":1}
I20260807 06:43:24.670042 18657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.665716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39174 (local address 127.11.137.129:45341)
0807 06:43:24.666219 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.666223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.666234 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:43:24.666274 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.666276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.666291 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.666540 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:24.666625 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.667313 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.668932 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.669691 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.669774 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.669825 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.669913 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.669950 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":96,"threads_started":1}
I20260807 06:43:24.670114 18661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.665995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.11.137.130:45691)
0807 06:43:24.666317 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.666321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.666331 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:24.666374 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.666376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.666390 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.666462 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:24.666685 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.667696 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.668899 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.669489 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.669578 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.669637 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.669979 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.670027 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":92,"threads_started":1}
I20260807 06:43:24.670138 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.665564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:45341 (local address 127.0.0.1:39174)
0807 06:43:24.665996 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.666008 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.666063 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.666396 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.666397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.666399 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:24.666450 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.666452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.667440 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.667442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.668837 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.668839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.669778 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.669779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.669833 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.669836 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.669896 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.669929 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":23,"thread_start_us":98,"threads_started":1}
I20260807 06:43:24.670713 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.665722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.11.137.131:45799)
0807 06:43:24.665922 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.665927 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.665935 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:24.665978 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.665979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.665991 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.666080 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:24.666346 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.667462 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.668932 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.669691 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.670493 (+ 802us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.670566 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.670591 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.670634 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":99,"threads_started":1}
I20260807 06:43:24.670802 18312 tablet_service.cc:1467] Processing CreateTablet for tablet ca901800ea6d4eec84f4038c68922181 (DEFAULT_TABLE table=test-table [id=dff50a4e35754b9b97b34a99a5fda5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:24.671026 18091 tablet_service.cc:1467] Processing CreateTablet for tablet ca901800ea6d4eec84f4038c68922181 (DEFAULT_TABLE table=test-table [id=dff50a4e35754b9b97b34a99a5fda5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:24.671196 18312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca901800ea6d4eec84f4038c68922181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:24.671303 18091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca901800ea6d4eec84f4038c68922181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:24.673841 18662 tablet_bootstrap.cc:492] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Bootstrap starting.
I20260807 06:43:24.673852 18663 tablet_bootstrap.cc:492] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: Bootstrap starting.
I20260807 06:43:24.674321 18533 tablet_service.cc:1467] Processing CreateTablet for tablet ca901800ea6d4eec84f4038c68922181 (DEFAULT_TABLE table=test-table [id=dff50a4e35754b9b97b34a99a5fda5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:24.674541 18663 tablet_bootstrap.cc:654] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:24.674606 18662 tablet_bootstrap.cc:654] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:24.674656 18533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca901800ea6d4eec84f4038c68922181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:24.675216 18662 log.cc:824] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:24.675256 18663 log.cc:824] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:24.675948 18662 tablet_bootstrap.cc:492] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: No bootstrap required, opened a new log
I20260807 06:43:24.676033 18662 ts_tablet_manager.cc:1397] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:24.677637 18669 tablet_bootstrap.cc:492] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Bootstrap starting.
I20260807 06:43:24.677779 18662 raft_consensus.cc:348] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.677938 18662 raft_consensus.cc:374] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:24.677963 18662 raft_consensus.cc:729] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3cb721d8a49459c92cf9de9b74b5970, State: Initialized, Role: FOLLOWER
I20260807 06:43:24.678090 18662 consensus_queue.cc:260] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.678321 18669 tablet_bootstrap.cc:654] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:24.678401 18662 ts_tablet_manager.cc:1428] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:43:24.678422 18412 heartbeater.cc:503] Master 127.11.137.190:41851 was elected leader, sending a full tablet report...
I20260807 06:43:24.678864 18663 tablet_bootstrap.cc:492] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: No bootstrap required, opened a new log
I20260807 06:43:24.678947 18663 ts_tablet_manager.cc:1397] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 06:43:24.678999 18669 log.cc:824] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:24.679862 18669 tablet_bootstrap.cc:492] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: No bootstrap required, opened a new log
I20260807 06:43:24.679932 18669 ts_tablet_manager.cc:1397] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:24.680872 18663 raft_consensus.cc:348] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.681016 18663 raft_consensus.cc:374] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:24.681057 18663 raft_consensus.cc:729] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7dbcd62baa345cdb672b3e52ef6d458, State: Initialized, Role: FOLLOWER
I20260807 06:43:24.681173 18663 consensus_queue.cc:260] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.681463 18663 ts_tablet_manager.cc:1428] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:43:24.681537 18202 heartbeater.cc:503] Master 127.11.137.190:41851 was elected leader, sending a full tablet report...
I20260807 06:43:24.681846 18669 raft_consensus.cc:348] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.682015 18669 raft_consensus.cc:374] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:24.682096 18669 raft_consensus.cc:729] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce773357fa14eb7971093cc1d03c4b9, State: Initialized, Role: FOLLOWER
I20260807 06:43:24.682229 18669 consensus_queue.cc:260] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.682577 18637 heartbeater.cc:503] Master 127.11.137.190:41851 was elected leader, sending a full tablet report...
I20260807 06:43:24.682583 18669 ts_tablet_manager.cc:1428] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260807 06:43:24.722486 18414 tablet.cc:2369] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:24.738536 18675 raft_consensus.cc:482] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:24.738677 18675 raft_consensus.cc:504] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.739082 18675 leader_election.cc:288] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bce773357fa14eb7971093cc1d03c4b9 (127.11.137.131:45799), c3cb721d8a49459c92cf9de9b74b5970 (127.11.137.130:45691)
I20260807 06:43:24.743228 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.739457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:42811 (local address 127.11.137.131:45799)
0807 06:43:24.739525 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.739527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.739535 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:24.739576 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.739577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.739586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.739642 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:24.739891 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.740635 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.742273 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.742860 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.742940 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.742949 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.743116 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.743159 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:43:24.743228 18661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.739400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:47829 (local address 127.11.137.130:45691)
0807 06:43:24.739452 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.739454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.739505 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:43:24.739538 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.739539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.739550 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.739608 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:24.739890 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.740653 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.742273 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.742855 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.742940 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.742949 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.743116 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.743159 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:43:24.743224 18204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.739273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45691 (local address 127.11.137.129:47829)
0807 06:43:24.739388 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.739400 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.739446 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.739650 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.739651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.739653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:24.739750 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.739751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.740732 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.740733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.742141 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.742145 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.742950 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.742951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.743036 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.743039 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.743091 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.743127 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":94}
I20260807 06:43:24.743239 18677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.739274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:45799 (local address 127.11.137.129:42811)
0807 06:43:24.739471 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.739487 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:24.739533 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:24.739658 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:24.739658 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:24.739660 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:24.739734 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.739737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.740732 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.740733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.742141 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:24.742145 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.742950 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.742951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:24.743020 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.743025 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:24.743085 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 06:43:24.743124 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":85,"thread_start_us":121,"threads_started":1}
I20260807 06:43:24.743599 18344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca901800ea6d4eec84f4038c68922181" candidate_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3cb721d8a49459c92cf9de9b74b5970" is_pre_election: true
I20260807 06:43:24.743651 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca901800ea6d4eec84f4038c68922181" candidate_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce773357fa14eb7971093cc1d03c4b9" is_pre_election: true
I20260807 06:43:24.743778 18344 raft_consensus.cc:2454] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7dbcd62baa345cdb672b3e52ef6d458 in term 0.
I20260807 06:43:24.743813 18565 raft_consensus.cc:2454] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7dbcd62baa345cdb672b3e52ef6d458 in term 0.
I20260807 06:43:24.744019 18009 leader_election.cc:302] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3cb721d8a49459c92cf9de9b74b5970, f7dbcd62baa345cdb672b3e52ef6d458; no voters:
I20260807 06:43:24.744146 18675 raft_consensus.cc:2781] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:24.744204 18675 raft_consensus.cc:482] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:24.744227 18675 raft_consensus.cc:3037] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:24.744940 18675 raft_consensus.cc:504] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.745097 18675 leader_election.cc:288] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [CANDIDATE]: Term 1 election: Requested vote from peers bce773357fa14eb7971093cc1d03c4b9 (127.11.137.131:45799), c3cb721d8a49459c92cf9de9b74b5970 (127.11.137.130:45691)
I20260807 06:43:24.745303 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca901800ea6d4eec84f4038c68922181" candidate_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce773357fa14eb7971093cc1d03c4b9"
I20260807 06:43:24.745302 18344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca901800ea6d4eec84f4038c68922181" candidate_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3cb721d8a49459c92cf9de9b74b5970"
I20260807 06:43:24.745378 18565 raft_consensus.cc:3037] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:24.745398 18344 raft_consensus.cc:3037] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:24.746102 18565 raft_consensus.cc:2454] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7dbcd62baa345cdb672b3e52ef6d458 in term 1.
I20260807 06:43:24.746294 18006 leader_election.cc:302] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce773357fa14eb7971093cc1d03c4b9, f7dbcd62baa345cdb672b3e52ef6d458; no voters:
I20260807 06:43:24.746419 18675 raft_consensus.cc:2781] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:24.746578 18344 raft_consensus.cc:2454] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7dbcd62baa345cdb672b3e52ef6d458 in term 1.
I20260807 06:43:24.746609 18675 raft_consensus.cc:686] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [term 1 LEADER]: Becoming Leader. State: Replica: f7dbcd62baa345cdb672b3e52ef6d458, State: Running, Role: LEADER
I20260807 06:43:24.746723 18675 consensus_queue.cc:237] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } }
I20260807 06:43:24.747684 17877 catalog_manager.cc:5495] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7dbcd62baa345cdb672b3e52ef6d458 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7dbcd62baa345cdb672b3e52ef6d458" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:24.764667 18657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.762154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39180 (local address 127.11.137.129:45341)
0807 06:43:24.762228 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.762229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.762239 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:24.762300 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.762301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.762321 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.762409 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:24.762555 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.763033 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.763820 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:24.764034 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:24.764127 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:24.764306 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:24.764415 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:24.764513 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.764533 (+ 20us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.764553 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:43:24.766677 18565 raft_consensus.cc:1261] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 1 FOLLOWER]: Refusing update from remote peer f7dbcd62baa345cdb672b3e52ef6d458: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:24.766677 18344 raft_consensus.cc:1261] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 1 FOLLOWER]: Refusing update from remote peer f7dbcd62baa345cdb672b3e52ef6d458: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:24.767021 18675 consensus_queue.cc:1035] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3cb721d8a49459c92cf9de9b74b5970" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:24.767166 18678 consensus_queue.cc:1035] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce773357fa14eb7971093cc1d03c4b9" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:24.772471 17876 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:24.772567 17876 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:24.774576 17876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5afd0ee4fbcf457e9994cb7d03b2466d: Sending DeleteTablet for 3 replicas of tablet ca901800ea6d4eec84f4038c68922181
I20260807 06:43:24.774906 18091 tablet_service.cc:1514] Processing DeleteTablet for tablet ca901800ea6d4eec84f4038c68922181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:24 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:39174
I20260807 06:43:24.774945 18533 tablet_service.cc:1514] Processing DeleteTablet for tablet ca901800ea6d4eec84f4038c68922181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:24 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:48746
I20260807 06:43:24.775015 18312 tablet_service.cc:1514] Processing DeleteTablet for tablet ca901800ea6d4eec84f4038c68922181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:24 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:50502
I20260807 06:43:24.775245 18698 tablet_replica.cc:330] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: stopping tablet replica
I20260807 06:43:24.775355 18698 raft_consensus.cc:2229] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:24.775511 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 17979
I20260807 06:43:24.784907 18698 raft_consensus.cc:2258] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:24.786887 18698 ts_tablet_manager.cc:1905] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:24.788753 18698 ts_tablet_manager.cc:1918] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:24.788816 18698 log.cc:1196] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/ca901800ea6d4eec84f4038c68922181
I20260807 06:43:24.789026 18698 ts_tablet_manager.cc:1939] T ca901800ea6d4eec84f4038c68922181 P c3cb721d8a49459c92cf9de9b74b5970: Deleting consensus metadata
I20260807 06:43:24.793423 17854 catalog_manager.cc:4841] TS c3cb721d8a49459c92cf9de9b74b5970 (127.11.137.130:45691): tablet ca901800ea6d4eec84f4038c68922181 (table test-table [id=dff50a4e35754b9b97b34a99a5fda5b8]) successfully deleted
I20260807 06:43:24.775454 18696 tablet_replica.cc:330] T ca901800ea6d4eec84f4038c68922181 P f7dbcd62baa345cdb672b3e52ef6d458: stopping tablet replica
I20260807 06:43:24.797991 18697 tablet_replica.cc:330] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: stopping tablet replica
I20260807 06:43:24.798171 18697 raft_consensus.cc:2229] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:24.798331 18697 raft_consensus.cc:2258] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:24.798856 18697 ts_tablet_manager.cc:1905] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:24.800650 18697 ts_tablet_manager.cc:1918] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:24.800741 18697 log.cc:1196] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/ca901800ea6d4eec84f4038c68922181
I20260807 06:43:24.801052 18697 ts_tablet_manager.cc:1939] T ca901800ea6d4eec84f4038c68922181 P bce773357fa14eb7971093cc1d03c4b9: Deleting consensus metadata
I20260807 06:43:24.801569 17853 catalog_manager.cc:4841] TS bce773357fa14eb7971093cc1d03c4b9 (127.11.137.131:45799): tablet ca901800ea6d4eec84f4038c68922181 (table test-table [id=dff50a4e35754b9b97b34a99a5fda5b8]) successfully deleted
W20260807 06:43:24.803303 17854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:45341 (error 108)
I20260807 06:43:24.803630 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 18208
I20260807 06:43:24.803886 18655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.803762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:45341 (local address 127.0.0.1:39188)
0807 06:43:24.803811 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:24.803845 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:45341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 06:43:24.807242 17854 catalog_manager.cc:4584] TS f7dbcd62baa345cdb672b3e52ef6d458 (127.11.137.129:45341): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca901800ea6d4eec84f4038c68922181: Network error: Client connection negotiation failed: client connection to 127.11.137.129:45341: connect: Connection refused (error 111)
I20260807 06:43:24.819080 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 18420
I20260807 06:43:24.835114 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 17823
2026-08-07T06:43:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2242 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T06:43:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:24Z Disabled control of system clock
I20260807 06:43:24.870388 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:32929
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:32929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:43:24.955242 18705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:24.955444 18705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:24.955466 18705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:24.956527 18705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:24.956559 18705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:24.956571 18705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:24.956583 18705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:24.956595 18705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:24.957935 18705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:32929
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:32929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:24.958125 18705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:24.958369 18705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:24.964366 18721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.964406 18714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:24.964365 18719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:24.964546 18705 server_base.cc:1034] running on GCE node
I20260807 06:43:24.964843 18705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:24.965095 18705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:24.966233 18705 hybrid_clock.cc:648] HybridClock initialized: now 1786085004966231 us; error 42 us; skew 500 ppm
I20260807 06:43:24.967509 18705 webserver.cc:460] Webserver started at http://127.11.137.190:39107/ using document root <none> and password file <none>
I20260807 06:43:24.967753 18705 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:24.967801 18705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:24.967958 18705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:24.969026 18705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "6acad246454a4d6296bcb80a2cad29b1"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "a31fd77179e104d13795910c590775b7"
server_key_iv: "dc165a18c55da9a4990a24e329678c83"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.969425 18705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "6acad246454a4d6296bcb80a2cad29b1"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "a31fd77179e104d13795910c590775b7"
server_key_iv: "dc165a18c55da9a4990a24e329678c83"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.970716 18705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:24.971426 18729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:24.971617 18705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:24.971747 18705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "6acad246454a4d6296bcb80a2cad29b1"
format_stamp: "Formatted at 2026-08-07 06:43:24 on dist-test-slave-8hhm"
server_key: "a31fd77179e104d13795910c590775b7"
server_key_iv: "dc165a18c55da9a4990a24e329678c83"
server_key_version: "encryptionkey@0"
I20260807 06:43:24.971827 18705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:24.975276 18705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:24.975539 18705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:24.975689 18705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:24.979730 18705 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:32929
I20260807 06:43:24.979761 18801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:32929 every 8 connection(s)
I20260807 06:43:24.980087 18705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:24.980798 18803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:24.983649 18803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1: Bootstrap starting.
I20260807 06:43:24.984181 18803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:24.984422 18803 log.cc:824] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:24.984709 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 18705
I20260807 06:43:24.984822 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:24.985024 11814 external_mini_cluster.cc:1428] Setting key 8935fd5b53cb2efb1dbfbb26732d5f9d
I20260807 06:43:24.985252 18803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1: No bootstrap required, opened a new log
I20260807 06:43:24.987057 18803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6acad246454a4d6296bcb80a2cad29b1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 32929 } }
I20260807 06:43:24.987231 18803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:24.987273 18803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6acad246454a4d6296bcb80a2cad29b1, State: Initialized, Role: FOLLOWER
I20260807 06:43:24.987411 18803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6acad246454a4d6296bcb80a2cad29b1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 32929 } }
I20260807 06:43:24.987528 18803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:24.987564 18803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:24.987627 18803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:24.988348 18803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6acad246454a4d6296bcb80a2cad29b1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 32929 } }
I20260807 06:43:24.988479 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:24.985603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.11.137.190:32929)
0807 06:43:24.985828 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:24.985836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:24.985860 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:43:24.987038 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:24.987045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:24.987082 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:24.987197 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:24.987955 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:24.987958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:24.987958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:24.987962 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:24.987997 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:24.988008 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:24.988064 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:24.988185 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 06:43:24.988261 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
I20260807 06:43:24.988479 18803 leader_election.cc:302] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6acad246454a4d6296bcb80a2cad29b1; no voters:
I20260807 06:43:24.988705 18803 leader_election.cc:288] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:24.988950 18803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:24.989017 18810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:24.989154 18810 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [term 1 LEADER]: Becoming Leader. State: Replica: 6acad246454a4d6296bcb80a2cad29b1, State: Running, Role: LEADER
I20260807 06:43:24.989289 18810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6acad246454a4d6296bcb80a2cad29b1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 32929 } }
I20260807 06:43:24.989782 18812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6acad246454a4d6296bcb80a2cad29b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6acad246454a4d6296bcb80a2cad29b1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 32929 } } }
I20260807 06:43:24.989895 18812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:24.990226 18821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:24.990211 18813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6acad246454a4d6296bcb80a2cad29b1. Latest consensus state: current_term: 1 leader_uuid: "6acad246454a4d6296bcb80a2cad29b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6acad246454a4d6296bcb80a2cad29b1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 32929 } } }
I20260807 06:43:24.990415 18813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:24.990851 18821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:24.992311 18821 catalog_manager.cc:1347] Generated new cluster ID: c22798f0d2aa42228882d1c1f4b670c9
I20260807 06:43:24.992364 18821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:25.000097 18821 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:25.000260 18821 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:25.007119 18821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1: Generated new TSK 0
I20260807 06:43:25.007309 18821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:25.015301 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:32929
--builtin_ntp_servers=127.11.137.148:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:43:25.109472 18834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:25.109702 18834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:25.109740 18834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:25.110978 18834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:25.111040 18834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:25.111092 18834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:25.112507 18834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:32929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:25.112779 18834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:25.113068 18834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:25.119064 18844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.119081 18845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.119076 18848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:25.119414 18834 server_base.cc:1034] running on GCE node
I20260807 06:43:25.119650 18834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:25.119916 18834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:25.121088 18834 hybrid_clock.cc:648] HybridClock initialized: now 1786085005121074 us; error 28 us; skew 500 ppm
I20260807 06:43:25.122605 18834 webserver.cc:460] Webserver started at http://127.11.137.129:34727/ using document root <none> and password file <none>
I20260807 06:43:25.122867 18834 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:25.122924 18834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:25.123055 18834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:25.124559 18834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "9ff30efa485a4a41a38ddbfada2f655c"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "425e8830a6d0ebde83b62deacef78a46"
server_key_iv: "35e95cfa2e21116ad82014eb8bb166b7"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.125006 18834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "9ff30efa485a4a41a38ddbfada2f655c"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "425e8830a6d0ebde83b62deacef78a46"
server_key_iv: "35e95cfa2e21116ad82014eb8bb166b7"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.126677 18834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:25.127652 18861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.127856 18834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:25.127969 18834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "9ff30efa485a4a41a38ddbfada2f655c"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "425e8830a6d0ebde83b62deacef78a46"
server_key_iv: "35e95cfa2e21116ad82014eb8bb166b7"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.128046 18834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:25.132588 18834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:25.132861 18834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:25.132980 18834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:25.133191 18834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:25.133522 18834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:25.133559 18834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.133589 18834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:25.133613 18834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.140694 18834 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:39359
I20260807 06:43:25.140751 19033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:39359 every 8 connection(s)
I20260807 06:43:25.141057 18834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:25.143889 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.141798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:46781 (local address 127.11.137.190:32929)
0807 06:43:25.141841 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.141843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.142065 (+ 222us) server_negotiation.cc:407] Connection header received
0807 06:43:25.142494 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.142494 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.142500 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.142561 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.143654 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.143655 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.143655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.143660 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.143693 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.143697 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.143752 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.143827 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.143839 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:43:25.144129 19037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.141753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:32929 (local address 127.11.137.129:46781)
0807 06:43:25.141931 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.141969 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.142414 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.142639 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.142642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.142650 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.143505 (+ 855us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.143506 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.143532 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.143558 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.143767 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.143772 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.143775 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.143830 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.143878 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260807 06:43:25.144455 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 18834
I20260807 06:43:25.144562 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:25.144763 11814 external_mini_cluster.cc:1428] Setting key 6874a21a8cfac1f4a99c07c0e4dda06c
I20260807 06:43:25.144788 19035 heartbeater.cc:347] Connected to a master server at 127.11.137.190:32929
I20260807 06:43:25.144904 19035 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:25.145051 19035 heartbeater.cc:511] Master 127.11.137.190:32929 requested a full tablet report, sending...
I20260807 06:43:25.145624 18753 ts_manager.cc:194] Registered new tserver with Master: 9ff30efa485a4a41a38ddbfada2f655c (127.11.137.129:39359)
I20260807 06:43:25.145706 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:32929
--builtin_ntp_servers=127.11.137.148:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:43:25.228063 19038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:25.228256 19038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:25.228277 19038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:25.229408 19038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:25.229445 19038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:25.229470 19038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:25.230886 19038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:32929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:25.231115 19038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:25.231396 19038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:25.236567 19049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.236555 19045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.236555 19046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:25.236855 19038 server_base.cc:1034] running on GCE node
I20260807 06:43:25.237071 19038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:25.237376 19038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:25.238538 19038 hybrid_clock.cc:648] HybridClock initialized: now 1786085005238519 us; error 31 us; skew 500 ppm
I20260807 06:43:25.239881 19038 webserver.cc:460] Webserver started at http://127.11.137.130:34157/ using document root <none> and password file <none>
I20260807 06:43:25.240156 19038 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:25.240231 19038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:25.240401 19038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:25.241619 19038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "dce96fe6af5644feb5fe94572847d1b4"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "72170d2c17c3ec75314faf8ebd08e8dd"
server_key_iv: "ff1d012b5446ec8f03cf5e6a8e43bb40"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.241997 19038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "dce96fe6af5644feb5fe94572847d1b4"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "72170d2c17c3ec75314faf8ebd08e8dd"
server_key_iv: "ff1d012b5446ec8f03cf5e6a8e43bb40"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.243306 19038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:25.244051 19063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.244235 19038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:25.244343 19038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "dce96fe6af5644feb5fe94572847d1b4"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "72170d2c17c3ec75314faf8ebd08e8dd"
server_key_iv: "ff1d012b5446ec8f03cf5e6a8e43bb40"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.244422 19038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:25.247792 19038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:25.248051 19038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:25.248216 19038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:25.248420 19038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:25.248744 19038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:25.248809 19038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.248850 19038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:25.248878 19038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.254786 19038 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:39849
I20260807 06:43:25.254863 19243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:39849 every 8 connection(s)
I20260807 06:43:25.255178 19038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:25.258136 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.255940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:42361 (local address 127.11.137.190:32929)
0807 06:43:25.255990 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.255993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.256244 (+ 251us) server_negotiation.cc:407] Connection header received
0807 06:43:25.256693 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.256694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.256700 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.256756 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.257934 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.257936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.257937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.257941 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.257959 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.257963 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.258012 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.258070 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.258081 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:25.258314 19247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.255932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:32929 (local address 127.11.137.130:42361)
0807 06:43:25.256128 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.256160 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.256588 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.256820 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.256823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.256830 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.257782 (+ 952us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.257783 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.257809 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.257837 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.258010 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.258013 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.258015 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.258064 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.258123 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260807 06:43:25.258795 19244 heartbeater.cc:347] Connected to a master server at 127.11.137.190:32929
I20260807 06:43:25.258881 19244 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:25.258988 19244 heartbeater.cc:511] Master 127.11.137.190:32929 requested a full tablet report, sending...
I20260807 06:43:25.259334 18753 ts_manager.cc:194] Registered new tserver with Master: dce96fe6af5644feb5fe94572847d1b4 (127.11.137.130:39849)
I20260807 06:43:25.261102 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 19038
I20260807 06:43:25.261201 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:25.261413 11814 external_mini_cluster.cc:1428] Setting key 583d27063de9c65f1b6585a49722c2f7
I20260807 06:43:25.262284 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:32929
--builtin_ntp_servers=127.11.137.148:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:43:25.344581 19248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:25.344792 19248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:25.344815 19248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:25.346091 19248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:25.346133 19248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:25.346158 19248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:25.347667 19248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:32929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:25.347932 19248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:25.348248 19248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:25.353415 19261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.353438 19258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.353430 19256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:25.353555 19248 server_base.cc:1034] running on GCE node
I20260807 06:43:25.353863 19248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:25.354105 19248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:25.355247 19248 hybrid_clock.cc:648] HybridClock initialized: now 1786085005355225 us; error 39 us; skew 500 ppm
I20260807 06:43:25.356406 19248 webserver.cc:460] Webserver started at http://127.11.137.131:37439/ using document root <none> and password file <none>
I20260807 06:43:25.356658 19248 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:25.356705 19248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:25.356878 19248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:25.358011 19248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "4d3c33c0beae49849a8a9544de87fe0b"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "becddee507450d5884db57a73e254875"
server_key_iv: "cf1968770b8d3ec258a91da19c3d39b1"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.358390 19248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "4d3c33c0beae49849a8a9544de87fe0b"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "becddee507450d5884db57a73e254875"
server_key_iv: "cf1968770b8d3ec258a91da19c3d39b1"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.359664 19248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:25.360390 19277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.360566 19248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:25.360682 19248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "4d3c33c0beae49849a8a9544de87fe0b"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "becddee507450d5884db57a73e254875"
server_key_iv: "cf1968770b8d3ec258a91da19c3d39b1"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.360760 19248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:25.364099 19248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:25.364364 19248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:25.364506 19248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:25.364720 19248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:25.365031 19248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:25.365089 19248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.365127 19248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:25.365155 19248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.371088 19248 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:44743
I20260807 06:43:25.371145 19459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:44743 every 8 connection(s)
I20260807 06:43:25.371420 19248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:25.374413 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.372124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:39015 (local address 127.11.137.190:32929)
0807 06:43:25.372220 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.372223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.372413 (+ 190us) server_negotiation.cc:407] Connection header received
0807 06:43:25.372910 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.372912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.372919 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.372970 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.374139 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.374140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.374141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.374146 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.374163 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.374167 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.374228 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.374327 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.374344 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:43:25.374614 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.372088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:32929 (local address 127.11.137.131:39015)
0807 06:43:25.372293 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.372331 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.372796 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.373037 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.373040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.373050 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.373971 (+ 921us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.373971 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.373999 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.374025 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.374227 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.374233 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.374236 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.374336 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.374397 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260807 06:43:25.375113 19460 heartbeater.cc:347] Connected to a master server at 127.11.137.190:32929
I20260807 06:43:25.375226 19460 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:25.375389 19460 heartbeater.cc:511] Master 127.11.137.190:32929 requested a full tablet report, sending...
I20260807 06:43:25.375778 18753 ts_manager.cc:194] Registered new tserver with Master: 4d3c33c0beae49849a8a9544de87fe0b (127.11.137.131:44743)
I20260807 06:43:25.377630 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 19248
I20260807 06:43:25.377718 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:25.377847 11814 external_mini_cluster.cc:1428] Setting key 94e7f4cf2d6f2772aef17d8d140f625f
I20260807 06:43:25.378656 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:25.381112 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.379968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.11.137.190:32929)
0807 06:43:25.380056 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.380058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.380145 (+ 87us) server_negotiation.cc:407] Connection header received
0807 06:43:25.380243 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.380244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.380250 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.380307 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.380846 (+ 539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.380847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.380848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.380852 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.380865 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.380869 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.380926 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.380991 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.381004 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:43:25.382608 18753 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:25.384114 18753 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:25.388578 19477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.386358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:39359 (local address 127.0.0.1:54068)
0807 06:43:25.386773 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.386782 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.386824 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.387336 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.387337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.387339 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.387954 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.387954 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.387962 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.387985 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.388260 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.388266 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.388386 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.388465 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.388479 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":84,"threads_started":1}
I20260807 06:43:25.388614 19475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.386465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54068 (local address 127.11.137.129:39359)
0807 06:43:25.386677 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.386681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.386894 (+ 213us) server_negotiation.cc:407] Connection header received
0807 06:43:25.386929 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.386931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.386942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.387010 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.388075 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.388089 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.388090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.388093 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.388144 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.388171 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.388245 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.388488 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.388518 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":96,"threads_started":1}
I20260807 06:43:25.388799 19474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.386453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43702 (local address 127.11.137.130:39849)
0807 06:43:25.386620 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.386625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.386794 (+ 169us) server_negotiation.cc:407] Connection header received
0807 06:43:25.386835 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.386837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.386849 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.386943 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.388164 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.388174 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.388175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.388179 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.388210 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.388236 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.388301 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.388621 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.388639 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
I20260807 06:43:25.388909 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.386357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:39849 (local address 127.0.0.1:43702)
0807 06:43:25.386671 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.386711 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.386785 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.387261 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.387268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.387274 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.387911 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.387912 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.388070 (+ 158us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.388080 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.388424 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.388425 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.388426 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.388478 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.388488 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":69,"threads_started":1}
I20260807 06:43:25.389277 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.386777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41262 (local address 127.11.137.131:44743)
0807 06:43:25.386979 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.386983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.387622 (+ 639us) server_negotiation.cc:407] Connection header received
0807 06:43:25.387672 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.387675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.387685 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.387784 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.388415 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.388421 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.388422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.388425 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.388455 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.388476 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.388542 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.388817 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.388830 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
I20260807 06:43:25.389392 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.386579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44743 (local address 127.0.0.1:41262)
0807 06:43:25.387543 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.387553 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.387604 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.387787 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.387788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.387790 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.388305 (+ 515us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.388306 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.388313 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.388325 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.388566 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.388567 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.388568 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.388639 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.388970 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"thread_start_us":61,"threads_started":1}
I20260807 06:43:25.389577 18935 tablet_service.cc:1467] Processing CreateTablet for tablet e568bc9db1594890b39199d892d49a72 (DEFAULT_TABLE table=test-table [id=7123bad2311a4289a68c3b3cd34c38ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:25.389628 19139 tablet_service.cc:1467] Processing CreateTablet for tablet e568bc9db1594890b39199d892d49a72 (DEFAULT_TABLE table=test-table [id=7123bad2311a4289a68c3b3cd34c38ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:25.389993 18935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e568bc9db1594890b39199d892d49a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:25.390002 19139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e568bc9db1594890b39199d892d49a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:25.390031 19348 tablet_service.cc:1467] Processing CreateTablet for tablet e568bc9db1594890b39199d892d49a72 (DEFAULT_TABLE table=test-table [id=7123bad2311a4289a68c3b3cd34c38ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:25.390342 19348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e568bc9db1594890b39199d892d49a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:25.392911 19480 tablet_bootstrap.cc:492] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: Bootstrap starting.
I20260807 06:43:25.393486 19481 tablet_bootstrap.cc:492] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Bootstrap starting.
I20260807 06:43:25.393796 19480 tablet_bootstrap.cc:654] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:25.393812 19483 tablet_bootstrap.cc:492] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Bootstrap starting.
I20260807 06:43:25.394191 19481 tablet_bootstrap.cc:654] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:25.394263 19480 log.cc:824] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:25.394440 19483 tablet_bootstrap.cc:654] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:25.394549 19481 log.cc:824] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:25.394811 19483 log.cc:824] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:25.395100 19480 tablet_bootstrap.cc:492] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: No bootstrap required, opened a new log
I20260807 06:43:25.395177 19480 ts_tablet_manager.cc:1397] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:43:25.395349 19481 tablet_bootstrap.cc:492] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: No bootstrap required, opened a new log
I20260807 06:43:25.395443 19481 ts_tablet_manager.cc:1397] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:25.395578 19483 tablet_bootstrap.cc:492] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: No bootstrap required, opened a new log
I20260807 06:43:25.395650 19483 ts_tablet_manager.cc:1397] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:25.397432 19481 raft_consensus.cc:348] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.397584 19481 raft_consensus.cc:374] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:25.397629 19481 raft_consensus.cc:729] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dce96fe6af5644feb5fe94572847d1b4, State: Initialized, Role: FOLLOWER
I20260807 06:43:25.397737 19481 consensus_queue.cc:260] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.398031 19481 ts_tablet_manager.cc:1428] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:25.398075 19244 heartbeater.cc:503] Master 127.11.137.190:32929 was elected leader, sending a full tablet report...
I20260807 06:43:25.397895 19480 raft_consensus.cc:348] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.398435 19480 raft_consensus.cc:374] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:25.398491 19480 raft_consensus.cc:729] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff30efa485a4a41a38ddbfada2f655c, State: Initialized, Role: FOLLOWER
I20260807 06:43:25.398360 19483 raft_consensus.cc:348] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.398550 19483 raft_consensus.cc:374] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:25.398586 19483 raft_consensus.cc:729] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3c33c0beae49849a8a9544de87fe0b, State: Initialized, Role: FOLLOWER
I20260807 06:43:25.398604 19480 consensus_queue.cc:260] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.398680 19483 consensus_queue.cc:260] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.398862 19480 ts_tablet_manager.cc:1428] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260807 06:43:25.398906 19483 ts_tablet_manager.cc:1428] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260807 06:43:25.398994 19035 heartbeater.cc:503] Master 127.11.137.190:32929 was elected leader, sending a full tablet report...
I20260807 06:43:25.399039 19460 heartbeater.cc:503] Master 127.11.137.190:32929 was elected leader, sending a full tablet report...
W20260807 06:43:25.505723 19245 tablet.cc:2369] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:25.570363 19489 raft_consensus.cc:482] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:25.570487 19489 raft_consensus.cc:504] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.570941 19489 leader_election.cc:288] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dce96fe6af5644feb5fe94572847d1b4 (127.11.137.130:39849), 4d3c33c0beae49849a8a9544de87fe0b (127.11.137.131:44743)
I20260807 06:43:25.572394 19474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.571261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:58215 (local address 127.11.137.130:39849)
0807 06:43:25.571318 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.571319 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.571352 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:43:25.571384 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.571386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.571393 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.571462 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.572146 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.572148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.572148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.572153 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.572171 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.572176 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.572251 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.572309 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.572324 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 06:43:25.572394 19037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.571158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:39849 (local address 127.11.137.129:58215)
0807 06:43:25.571246 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.571258 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.571296 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.571486 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.571487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.571490 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.572020 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.572020 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.572028 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.572039 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.572248 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.572249 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.572250 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.572308 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.572324 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 06:43:25.572768 19172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e568bc9db1594890b39199d892d49a72" candidate_uuid: "9ff30efa485a4a41a38ddbfada2f655c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dce96fe6af5644feb5fe94572847d1b4" is_pre_election: true
I20260807 06:43:25.572924 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.571205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44743 (local address 127.11.137.129:60241)
0807 06:43:25.571381 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.571391 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.571450 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.571612 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.571612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.571615 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:25.572232 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:25.572233 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:25.572240 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:25.572253 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:25.572730 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:25.572731 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:25.572732 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 06:43:25.572808 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:43:25.572825 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":101,"threads_started":1}
I20260807 06:43:25.572911 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.571300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:60241 (local address 127.11.137.131:44743)
0807 06:43:25.571350 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.571351 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.571461 (+ 110us) server_negotiation.cc:407] Connection header received
0807 06:43:25.571511 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.571512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.571518 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.571592 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.572349 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.572350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.572351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.572356 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.572376 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.572385 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.572644 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.572809 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.572825 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 06:43:25.572934 19172 raft_consensus.cc:2454] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ff30efa485a4a41a38ddbfada2f655c in term 0.
I20260807 06:43:25.573292 18862 leader_election.cc:302] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ff30efa485a4a41a38ddbfada2f655c, dce96fe6af5644feb5fe94572847d1b4; no voters:
I20260807 06:43:25.573321 19389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e568bc9db1594890b39199d892d49a72" candidate_uuid: "9ff30efa485a4a41a38ddbfada2f655c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3c33c0beae49849a8a9544de87fe0b" is_pre_election: true
I20260807 06:43:25.573459 19389 raft_consensus.cc:2454] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ff30efa485a4a41a38ddbfada2f655c in term 0.
I20260807 06:43:25.573470 19489 raft_consensus.cc:2781] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:25.573580 19489 raft_consensus.cc:482] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:25.573618 19489 raft_consensus.cc:3037] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:25.574496 19489 raft_consensus.cc:504] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.574676 19489 leader_election.cc:288] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [CANDIDATE]: Term 1 election: Requested vote from peers dce96fe6af5644feb5fe94572847d1b4 (127.11.137.130:39849), 4d3c33c0beae49849a8a9544de87fe0b (127.11.137.131:44743)
I20260807 06:43:25.574832 19172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e568bc9db1594890b39199d892d49a72" candidate_uuid: "9ff30efa485a4a41a38ddbfada2f655c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dce96fe6af5644feb5fe94572847d1b4"
I20260807 06:43:25.574852 19389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e568bc9db1594890b39199d892d49a72" candidate_uuid: "9ff30efa485a4a41a38ddbfada2f655c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3c33c0beae49849a8a9544de87fe0b"
I20260807 06:43:25.574927 19172 raft_consensus.cc:3037] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:25.574955 19389 raft_consensus.cc:3037] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:25.575798 19172 raft_consensus.cc:2454] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ff30efa485a4a41a38ddbfada2f655c in term 1.
I20260807 06:43:25.575956 19389 raft_consensus.cc:2454] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ff30efa485a4a41a38ddbfada2f655c in term 1.
I20260807 06:43:25.575976 18862 leader_election.cc:302] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ff30efa485a4a41a38ddbfada2f655c, dce96fe6af5644feb5fe94572847d1b4; no voters:
I20260807 06:43:25.576205 19489 raft_consensus.cc:2781] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:25.576362 19489 raft_consensus.cc:686] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 1 LEADER]: Becoming Leader. State: Replica: 9ff30efa485a4a41a38ddbfada2f655c, State: Running, Role: LEADER
I20260807 06:43:25.576471 19489 consensus_queue.cc:237] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } }
I20260807 06:43:25.577346 18752 catalog_manager.cc:5495] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ff30efa485a4a41a38ddbfada2f655c (127.11.137.129). New cstate: current_term: 1 leader_uuid: "9ff30efa485a4a41a38ddbfada2f655c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ff30efa485a4a41a38ddbfada2f655c" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:25.616173 19475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.615206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.11.137.129:39359)
0807 06:43:25.615280 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.615282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.615292 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:25.615340 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.615341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.615355 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.615420 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.615960 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.615961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.615961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.615965 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.615981 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.615986 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.616067 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.616105 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.616116 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 06:43:25.618216 19172 raft_consensus.cc:1261] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 1 FOLLOWER]: Refusing update from remote peer 9ff30efa485a4a41a38ddbfada2f655c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:25.618216 19389 raft_consensus.cc:1261] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 1 FOLLOWER]: Refusing update from remote peer 9ff30efa485a4a41a38ddbfada2f655c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:25.618708 19492 consensus_queue.cc:1035] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3c33c0beae49849a8a9544de87fe0b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:25.618840 19489 consensus_queue.cc:1035] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dce96fe6af5644feb5fe94572847d1b4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 39849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:25.622087 19496 mvcc.cc:205] Tried to move back new op lower bound from 7315804183009116160 to 7315804182841790464. Current Snapshot: MvccSnapshot[applied={T|T < 7315804183009116160}]
I20260807 06:43:25.623972 18752 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:25.624078 18752 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:25.624864 18752 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6acad246454a4d6296bcb80a2cad29b1: Sending DeleteTablet for 3 replicas of tablet e568bc9db1594890b39199d892d49a72
I20260807 06:43:25.625186 18935 tablet_service.cc:1514] Processing DeleteTablet for tablet e568bc9db1594890b39199d892d49a72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:25 UTC) from {username='slave'} at 127.0.0.1:54068
I20260807 06:43:25.625257 19139 tablet_service.cc:1514] Processing DeleteTablet for tablet e568bc9db1594890b39199d892d49a72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:25 UTC) from {username='slave'} at 127.0.0.1:43702
I20260807 06:43:25.625470 19507 tablet_replica.cc:330] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: stopping tablet replica
I20260807 06:43:25.625506 19348 tablet_service.cc:1514] Processing DeleteTablet for tablet e568bc9db1594890b39199d892d49a72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:25 UTC) from {username='slave'} at 127.0.0.1:41262
I20260807 06:43:25.625581 19507 raft_consensus.cc:2229] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:25.625685 19507 raft_consensus.cc:2258] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:25.625766 19510 tablet_replica.cc:330] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: stopping tablet replica
I20260807 06:43:25.625922 19510 raft_consensus.cc:2229] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:25.626005 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 18834
I20260807 06:43:25.626199 19507 ts_tablet_manager.cc:1905] T e568bc9db1594890b39199d892d49a72 P 9ff30efa485a4a41a38ddbfada2f655c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:25.630411 19510 raft_consensus.cc:2258] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:25.632097 19510 ts_tablet_manager.cc:1905] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:25.633026 19509 tablet_replica.cc:330] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: stopping tablet replica
I20260807 06:43:25.633168 19509 raft_consensus.cc:2229] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:25.633311 19509 raft_consensus.cc:2258] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:25.633800 19509 ts_tablet_manager.cc:1905] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:25.634019 19510 ts_tablet_manager.cc:1918] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:25.634114 19510 log.cc:1196] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/e568bc9db1594890b39199d892d49a72
I20260807 06:43:25.634372 19510 ts_tablet_manager.cc:1939] T e568bc9db1594890b39199d892d49a72 P 4d3c33c0beae49849a8a9544de87fe0b: Deleting consensus metadata
I20260807 06:43:25.635123 18733 catalog_manager.cc:4841] TS 4d3c33c0beae49849a8a9544de87fe0b (127.11.137.131:44743): tablet e568bc9db1594890b39199d892d49a72 (table test-table [id=7123bad2311a4289a68c3b3cd34c38ed]) successfully deleted
I20260807 06:43:25.635762 19509 ts_tablet_manager.cc:1918] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:25.635845 19509 log.cc:1196] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/e568bc9db1594890b39199d892d49a72
I20260807 06:43:25.636096 19509 ts_tablet_manager.cc:1939] T e568bc9db1594890b39199d892d49a72 P dce96fe6af5644feb5fe94572847d1b4: Deleting consensus metadata
I20260807 06:43:25.636554 18730 catalog_manager.cc:4841] TS dce96fe6af5644feb5fe94572847d1b4 (127.11.137.130:39849): tablet e568bc9db1594890b39199d892d49a72 (table test-table [id=7123bad2311a4289a68c3b3cd34c38ed]) successfully deleted
W20260807 06:43:25.637444 18733 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:39359 (error 108)
I20260807 06:43:25.637753 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 19038
I20260807 06:43:25.642038 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.637847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:39359 (local address 127.0.0.1:54090)
0807 06:43:25.641931 (+ 4084us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.641991 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:39359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4057}
W20260807 06:43:25.642220 18733 catalog_manager.cc:4584] TS 9ff30efa485a4a41a38ddbfada2f655c (127.11.137.129:39359): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e568bc9db1594890b39199d892d49a72: Network error: Client connection negotiation failed: client connection to 127.11.137.129:39359: connect: Connection refused (error 111)
I20260807 06:43:25.649461 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 19248
I20260807 06:43:25.658876 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 18705
2026-08-07T06:43:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (821 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 06:43:25.684119 11814 mini_oidc.cc:152] Starting JWKS server
I20260807 06:43:25.685361 11814 webserver.cc:460] Webserver started at https://127.0.0.1:42745/ using document root <none> and password file <none>
I20260807 06:43:25.685477 11814 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:43:25.685690 11814 webserver.cc:460] Webserver started at http://127.0.0.1:39995/ using document root <none> and password file <none>
2026-08-07T06:43:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:25Z Disabled control of system clock
I20260807 06:43:25.694994 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46839
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:38635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:46839
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42745/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/testchainca.cert with env {}
W20260807 06:43:25.777546 19523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:25.777762 19523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:25.777786 19523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:25.779028 19523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:25.779066 19523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:25.779079 19523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:25.779093 19523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:25.779106 19523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:43:25.779120 19523 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:43:25.779132 19523 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42745/jwks.json
I20260807 06:43:25.780809 19523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:46839
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42745/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:25.781032 19523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:25.781230 19523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:25.786749 19532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:25.786801 19523 server_base.cc:1034] running on GCE node
W20260807 06:43:25.786754 19534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:25.786763 19530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:25.787225 19523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:25.787535 19523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:25.788707 19523 hybrid_clock.cc:648] HybridClock initialized: now 1786085005788696 us; error 40 us; skew 500 ppm
I20260807 06:43:25.790130 19523 webserver.cc:460] Webserver started at http://127.11.137.190:36099/ using document root <none> and password file <none>
I20260807 06:43:25.790413 19523 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:25.790489 19523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:25.790647 19523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:25.791759 19523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "5977e04e258148c7af3fd9abdabcd10f"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "fab321c9a5b218a3435df33f4b832daf"
server_key_iv: "35b3056fdee4695c4c18416ef27b7233"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.792129 19523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "5977e04e258148c7af3fd9abdabcd10f"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "fab321c9a5b218a3435df33f4b832daf"
server_key_iv: "35b3056fdee4695c4c18416ef27b7233"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.793473 19523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:25.794241 19541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:25.794447 19523 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:25.794559 19523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "5977e04e258148c7af3fd9abdabcd10f"
format_stamp: "Formatted at 2026-08-07 06:43:25 on dist-test-slave-8hhm"
server_key: "fab321c9a5b218a3435df33f4b832daf"
server_key_iv: "35b3056fdee4695c4c18416ef27b7233"
server_key_version: "encryptionkey@0"
I20260807 06:43:25.794638 19523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:25.808557 19523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:25.808892 19523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:25.809051 19523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:25.813191 19523 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:46839
I20260807 06:43:25.813278 19622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:46839 every 8 connection(s)
I20260807 06:43:25.813647 19523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:25.814829 19625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:25.817579 19625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f: Bootstrap starting.
I20260807 06:43:25.818205 19625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:25.818524 19625 log.cc:824] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:25.819269 19625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f: No bootstrap required, opened a new log
I20260807 06:43:25.819410 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 19523
I20260807 06:43:25.819543 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:25.819736 11814 external_mini_cluster.cc:1428] Setting key d0990be38f9832896977d91561a90785
I20260807 06:43:25.821915 19625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5977e04e258148c7af3fd9abdabcd10f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46839 } }
I20260807 06:43:25.822132 19625 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:25.822177 19625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5977e04e258148c7af3fd9abdabcd10f, State: Initialized, Role: FOLLOWER
I20260807 06:43:25.822345 19625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5977e04e258148c7af3fd9abdabcd10f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46839 } }
I20260807 06:43:25.822443 19625 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:25.822476 19625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:25.822520 19625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:25.823251 19625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5977e04e258148c7af3fd9abdabcd10f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46839 } }
I20260807 06:43:25.823359 19625 leader_election.cc:302] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5977e04e258148c7af3fd9abdabcd10f; no voters:
I20260807 06:43:25.823501 19625 leader_election.cc:288] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:25.823581 19633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:25.823755 19633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [term 1 LEADER]: Becoming Leader. State: Replica: 5977e04e258148c7af3fd9abdabcd10f, State: Running, Role: LEADER
I20260807 06:43:25.823812 19625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:25.823850 19633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5977e04e258148c7af3fd9abdabcd10f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46839 } }
I20260807 06:43:25.824185 19633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5977e04e258148c7af3fd9abdabcd10f. Latest consensus state: current_term: 1 leader_uuid: "5977e04e258148c7af3fd9abdabcd10f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5977e04e258148c7af3fd9abdabcd10f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46839 } } }
I20260807 06:43:25.824245 19633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:25.824360 19635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5977e04e258148c7af3fd9abdabcd10f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5977e04e258148c7af3fd9abdabcd10f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46839 } } }
I20260807 06:43:25.824431 19635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:25.825263 19640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:25.825763 19640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:25.827531 19640 catalog_manager.cc:1347] Generated new cluster ID: ff0b2bc8da8d458093a08ac39e894e46
I20260807 06:43:25.827579 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.820265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56596 (local address 127.11.137.190:46839)
0807 06:43:25.820494 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.820504 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.820565 (+ 61us) server_negotiation.cc:407] Connection header received
0807 06:43:25.821478 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.821487 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.821569 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.821739 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:25.821984 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:25.823774 (+ 1790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:25.824999 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:25.825652 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:25.825805 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:25.826873 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:25.826876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:25.826877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:25.827040 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:25.827074 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:25.827084 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:25.827176 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:25.827277 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 06:43:25.827353 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":87,"threads_started":1}
I20260807 06:43:25.827579 19640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:25.828732 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:43:25.838965 19640 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:25.839691 19640 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:25.844467 19640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5977e04e258148c7af3fd9abdabcd10f: Generated new TSK 0
I20260807 06:43:25.844686 19640 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 06:43:25.875420 19669 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 06:43:25.875571 19669 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:43:25.875671 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:25.851274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56598 (local address 127.11.137.190:46839)
0807 06:43:25.851336 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:25.851339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:25.851520 (+ 181us) server_negotiation.cc:407] Connection header received
0807 06:43:25.851634 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:25.851635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:25.851645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:25.851715 (+ 70us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:43:25.851889 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:25.852382 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:25.853563 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:25.853763 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:25.853815 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:25.854070 (+ 255us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:43:25.875369 (+ 21299us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42745/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 06:43:25.875567 (+ 198us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56598: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42745/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 06:43:25.875731 19631 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56598: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42745/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 06:43:25.876109 19668 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:25.851190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46839 (local address 127.0.0.1:56598)
0807 06:43:25.851436 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:25.851449 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:25.851537 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:25.851736 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:25.851737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:25.851739 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:43:25.851818 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:25.851821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:25.852478 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:25.852479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:25.853467 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:25.853470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:25.853852 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:25.853853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:25.853922 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:25.853947 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:43:25.875527 (+ 21580us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42745/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 06:43:25.875652 (+ 125us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.137.190:46839: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42745/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":100,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.137.190:46839: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42745/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 06:43:25.876744 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 19523
2026-08-07T06:43:25Z chronyd exiting
I20260807 06:43:25.923765 11814 test_util.cc:175] -----------------------------------------------
I20260807 06:43:25.923844 11814 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786084979847518-11814-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (240 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 06:43:25.924602 11814 mini_oidc.cc:152] Starting JWKS server
I20260807 06:43:25.925381 11814 webserver.cc:460] Webserver started at https://127.0.0.1:42115/ using document root <none> and password file <none>
I20260807 06:43:25.925426 11814 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:43:25.925650 11814 webserver.cc:460] Webserver started at http://127.0.0.1:43139/ using document root <none> and password file <none>
2026-08-07T06:43:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:25Z Disabled control of system clock
I20260807 06:43:25.934567 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45109
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:45109
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42115/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/testchainca.cert with env {}
W20260807 06:43:26.020507 19677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:26.020720 19677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:26.020744 19677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:26.022030 19677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:26.022075 19677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:26.022089 19677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:26.022101 19677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:26.022154 19677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:43:26.022173 19677 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:43:26.022202 19677 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42115/jwks.json
I20260807 06:43:26.023736 19677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:45109
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42115/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:26.023993 19677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:26.024216 19677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:26.029475 19686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:26.029480 19684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:26.029608 19677 server_base.cc:1034] running on GCE node
W20260807 06:43:26.029511 19688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:26.030059 19677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:26.030388 19677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:26.031560 19677 hybrid_clock.cc:648] HybridClock initialized: now 1786085006031550 us; error 38 us; skew 500 ppm
I20260807 06:43:26.032791 19677 webserver.cc:460] Webserver started at http://127.11.137.190:39469/ using document root <none> and password file <none>
I20260807 06:43:26.033039 19677 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:26.033110 19677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:26.033270 19677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:26.034300 19677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "18332a00878d4d009aa99b381b0c7fb3"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "0470e176d6e0641e4f03c2dac63c0acf"
server_key_iv: "7e68e813481f1d5de6e7d371fd9cf095"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.034723 19677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "18332a00878d4d009aa99b381b0c7fb3"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "0470e176d6e0641e4f03c2dac63c0acf"
server_key_iv: "7e68e813481f1d5de6e7d371fd9cf095"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.036028 19677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:26.036836 19695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:26.037032 19677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:26.037143 19677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "18332a00878d4d009aa99b381b0c7fb3"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "0470e176d6e0641e4f03c2dac63c0acf"
server_key_iv: "7e68e813481f1d5de6e7d371fd9cf095"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.037240 19677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:26.050451 19677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:26.050750 19677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:26.050902 19677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:26.054879 19677 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:45109
I20260807 06:43:26.054930 19777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:45109 every 8 connection(s)
I20260807 06:43:26.055297 19677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:26.055984 19778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:26.058952 19778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3: Bootstrap starting.
I20260807 06:43:26.059247 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 19677
I20260807 06:43:26.059372 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:26.059562 11814 external_mini_cluster.cc:1428] Setting key 2e5acb5cfcca4e346529e8f0ec1620e5
I20260807 06:43:26.059756 19778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:26.060104 19778 log.cc:824] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:26.060812 19778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3: No bootstrap required, opened a new log
I20260807 06:43:26.062681 19778 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18332a00878d4d009aa99b381b0c7fb3" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45109 } }
I20260807 06:43:26.062840 19778 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:26.062891 19778 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18332a00878d4d009aa99b381b0c7fb3, State: Initialized, Role: FOLLOWER
I20260807 06:43:26.063033 19778 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18332a00878d4d009aa99b381b0c7fb3" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45109 } }
I20260807 06:43:26.063117 19778 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:26.063146 19778 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:26.063182 19778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:26.063900 19778 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18332a00878d4d009aa99b381b0c7fb3" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45109 } }
I20260807 06:43:26.064039 19778 leader_election.cc:302] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18332a00878d4d009aa99b381b0c7fb3; no voters:
I20260807 06:43:26.064203 19778 leader_election.cc:288] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:26.064360 19785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:26.064498 19785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [term 1 LEADER]: Becoming Leader. State: Replica: 18332a00878d4d009aa99b381b0c7fb3, State: Running, Role: LEADER
I20260807 06:43:26.064481 19778 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:26.064599 19785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18332a00878d4d009aa99b381b0c7fb3" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45109 } }
I20260807 06:43:26.064916 19785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18332a00878d4d009aa99b381b0c7fb3. Latest consensus state: current_term: 1 leader_uuid: "18332a00878d4d009aa99b381b0c7fb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18332a00878d4d009aa99b381b0c7fb3" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45109 } } }
I20260807 06:43:26.065021 19785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:26.064952 19786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18332a00878d4d009aa99b381b0c7fb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18332a00878d4d009aa99b381b0c7fb3" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45109 } } }
I20260807 06:43:26.065297 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:26.060084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37330 (local address 127.11.137.190:45109)
0807 06:43:26.060351 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:26.060358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:26.060384 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:43:26.060823 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:26.060829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:26.060929 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:26.061092 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:26.061299 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.062160 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.062975 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.063585 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.063726 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.064499 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:26.064503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:26.064504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:26.064719 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:26.064759 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:26.064772 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:26.064811 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:26.064952 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 06:43:26.065055 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":79,"threads_started":1}
I20260807 06:43:26.065486 19794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:26.065279 19786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:26.066025 19794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:26.066435 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:43:26.067831 19794 catalog_manager.cc:1347] Generated new cluster ID: 45220d36cdaa43da8bea2e22f80c7ffc
I20260807 06:43:26.067905 19794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:26.084359 19794 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:26.085032 19794 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:26.094257 19794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18332a00878d4d009aa99b381b0c7fb3: Generated new TSK 0
I20260807 06:43:26.094439 19794 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 06:43:26.124271 19824 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 06:43:26.124352 19824 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:43:26.124630 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:26.102715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37338 (local address 127.11.137.190:45109)
0807 06:43:26.102782 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:26.102784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:26.102881 (+ 97us) server_negotiation.cc:407] Connection header received
0807 06:43:26.102968 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:26.102969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:26.102981 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:26.103066 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:43:26.103225 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.103728 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.104521 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.104749 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.104827 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.105003 (+ 176us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:43:26.124395 (+ 19392us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42115/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 06:43:26.124546 (+ 151us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37338: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42115/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 06:43:26.124722 19781 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37338: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42115/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 06:43:26.124742 19823 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:26.102662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45109 (local address 127.0.0.1:37338)
0807 06:43:26.102810 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:26.102820 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:26.102898 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:26.103066 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:26.103067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:26.103069 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:43:26.103130 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:26.103132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.103814 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.103815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:26.104431 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:26.104433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.104828 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.104829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:26.104888 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.104893 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:43:26.124533 (+ 19640us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42115/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 06:43:26.124635 (+ 102us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.137.190:45109: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42115/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260807 06:43:26.125066 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 19677
2026-08-07T06:43:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (246 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 06:43:26.170876 11814 mini_oidc.cc:152] Starting JWKS server
I20260807 06:43:26.171536 11814 webserver.cc:460] Webserver started at https://127.0.0.1:46199/ using document root <none> and password file <none>
I20260807 06:43:26.171579 11814 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:43:26.171743 11814 webserver.cc:460] Webserver started at http://127.0.0.1:32863/ using document root <none> and password file <none>
2026-08-07T06:43:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:26Z Disabled control of system clock
I20260807 06:43:26.180521 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:44109
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:37755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:44109
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46199/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 06:43:26.262072 19832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:26.262316 19832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:26.262353 19832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:26.263507 19832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:26.263577 19832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:26.263599 19832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:26.263619 19832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:26.263650 19832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:43:26.263690 19832 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:43:26.263713 19832 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46199/jwks.json
I20260807 06:43:26.265054 19832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:44109
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:44109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46199/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:26.265359 19832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:26.265645 19832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:26.270547 19839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:26.270614 19845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:26.270560 19842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:26.270789 19832 server_base.cc:1034] running on GCE node
I20260807 06:43:26.271045 19832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:26.271339 19832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:26.272504 19832 hybrid_clock.cc:648] HybridClock initialized: now 1786085006272479 us; error 36 us; skew 500 ppm
I20260807 06:43:26.273753 19832 webserver.cc:460] Webserver started at http://127.11.137.190:37999/ using document root <none> and password file <none>
I20260807 06:43:26.273990 19832 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:26.274058 19832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:26.274227 19832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:26.275269 19832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "91b626c6def144adaa5b218d6bb8de39"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "71f37fcfbb5ada146fc9dbdf60ea332e"
server_key_iv: "894f0b1d6bc37b1cb4ef9c1c3803ea0e"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.275640 19832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "91b626c6def144adaa5b218d6bb8de39"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "71f37fcfbb5ada146fc9dbdf60ea332e"
server_key_iv: "894f0b1d6bc37b1cb4ef9c1c3803ea0e"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.276968 19832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:43:26.277772 19853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:26.277969 19832 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:26.278093 19832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "91b626c6def144adaa5b218d6bb8de39"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "71f37fcfbb5ada146fc9dbdf60ea332e"
server_key_iv: "894f0b1d6bc37b1cb4ef9c1c3803ea0e"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.278182 19832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:26.294983 19832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:26.295295 19832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:26.295454 19832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:26.299654 19832 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:44109
I20260807 06:43:26.299690 19937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:44109 every 8 connection(s)
I20260807 06:43:26.300031 19832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:26.300729 19938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:26.303553 19938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39: Bootstrap starting.
I20260807 06:43:26.304175 19938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:26.304476 19938 log.cc:824] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:26.304899 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 19832
I20260807 06:43:26.305027 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:26.305259 11814 external_mini_cluster.cc:1428] Setting key 5bd955e59170f03e45e3f1f54ac01904
I20260807 06:43:26.305374 19938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39: No bootstrap required, opened a new log
I20260807 06:43:26.307216 19938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b626c6def144adaa5b218d6bb8de39" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44109 } }
I20260807 06:43:26.307384 19938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:26.307430 19938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b626c6def144adaa5b218d6bb8de39, State: Initialized, Role: FOLLOWER
I20260807 06:43:26.307570 19938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b626c6def144adaa5b218d6bb8de39" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44109 } }
I20260807 06:43:26.307672 19938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:26.307718 19938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:26.307767 19938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:26.308329 19938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b626c6def144adaa5b218d6bb8de39" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44109 } }
I20260807 06:43:26.308451 19938 leader_election.cc:302] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91b626c6def144adaa5b218d6bb8de39; no voters:
I20260807 06:43:26.308614 19938 leader_election.cc:288] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:26.308646 19944 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:26.308789 19944 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [term 1 LEADER]: Becoming Leader. State: Replica: 91b626c6def144adaa5b218d6bb8de39, State: Running, Role: LEADER
I20260807 06:43:26.308876 19938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:26.308872 19944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b626c6def144adaa5b218d6bb8de39" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44109 } }
I20260807 06:43:26.309331 19945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91b626c6def144adaa5b218d6bb8de39. Latest consensus state: current_term: 1 leader_uuid: "91b626c6def144adaa5b218d6bb8de39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b626c6def144adaa5b218d6bb8de39" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44109 } } }
I20260807 06:43:26.309410 19945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:26.310042 19951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:26.310631 19951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:26.310853 19946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91b626c6def144adaa5b218d6bb8de39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91b626c6def144adaa5b218d6bb8de39" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44109 } } }
I20260807 06:43:26.311365 19946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:26.312264 19951 catalog_manager.cc:1347] Generated new cluster ID: afb4d65471804cc88cfe91b52c048155
I20260807 06:43:26.312322 19951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:26.312788 19943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:26.305825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54542 (local address 127.11.137.190:44109)
0807 06:43:26.306159 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:26.306166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:26.306197 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:43:26.307198 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:26.307205 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:26.307272 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:26.307415 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:26.307645 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.309268 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.310389 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.310976 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.311096 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.311854 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:26.311858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:26.311858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:26.312092 (+ 234us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:26.312134 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:26.312148 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:26.312444 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:26.312483 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 06:43:26.312565 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":82,"threads_started":1}
I20260807 06:43:26.314015 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:43:26.330847 19951 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:26.331357 19951 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:26.338485 19951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91b626c6def144adaa5b218d6bb8de39: Generated new TSK 0
I20260807 06:43:26.338665 19951 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:26.355501 19943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:26.351621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54552 (local address 127.11.137.190:44109)
0807 06:43:26.351687 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:26.351690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:26.351824 (+ 134us) server_negotiation.cc:407] Connection header received
0807 06:43:26.351862 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:26.351863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:26.351877 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:26.351946 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:43:26.352085 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.352828 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.353700 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.354011 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.354095 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.354256 (+ 161us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:43:26.355279 (+ 1023us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46199/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 06:43:26.355418 (+ 139us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54552: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46199/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 06:43:26.355568 19943 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54552: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46199/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 06:43:26.357314 19984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:26.351526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:44109 (local address 127.0.0.1:54552)
0807 06:43:26.351703 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:26.351732 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:26.351784 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:26.351952 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:26.351953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:26.351955 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:43:26.352005 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:26.352006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.352923 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.352924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:26.353606 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:26.353609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.354106 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.354107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:26.354148 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.354152 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:43:26.355386 (+ 1234us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46199/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 06:43:26.357202 (+ 1816us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.137.190:44109: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46199/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":1616,"thread_start_us":107,"threads_started":1}
I20260807 06:43:26.357574 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 19832
E20260807 06:43:26.374585 19987 webserver.cc:533] Webserver: sslize failed:
E20260807 06:43:26.374660 19987 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T06:43:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (235 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T06:43:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:26Z Disabled control of system clock
I20260807 06:43:26.415064 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:38851
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:38851
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/testchainca.cert with env {}
W20260807 06:43:26.496151 19994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:26.496353 19994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:26.496374 19994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:26.497577 19994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:26.497617 19994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:26.497629 19994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:26.497641 19994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:26.497689 19994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:43:26.497709 19994 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:43:26.497735 19994 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 06:43:26.499305 19994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:38851
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:38851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:26.499522 19994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:26.499722 19994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:26.504563 20005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:26.504549 20004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:26.504622 19994 server_base.cc:1034] running on GCE node
W20260807 06:43:26.504539 20010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:26.504995 19994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:26.505350 19994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:26.506497 19994 hybrid_clock.cc:648] HybridClock initialized: now 1786085006506483 us; error 29 us; skew 500 ppm
I20260807 06:43:26.507634 19994 webserver.cc:460] Webserver started at http://127.11.137.190:43593/ using document root <none> and password file <none>
I20260807 06:43:26.507870 19994 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:26.507915 19994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:26.508068 19994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:26.509070 19994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "70c8004eb6d445c88b2d2159b65d9504"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "8458bbfbf6a0ab019748f99cc1540d7c"
server_key_iv: "aa96f26dbeacef69e863f17e061f3691"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.509459 19994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "70c8004eb6d445c88b2d2159b65d9504"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "8458bbfbf6a0ab019748f99cc1540d7c"
server_key_iv: "aa96f26dbeacef69e863f17e061f3691"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.510761 19994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:26.511471 20018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:26.511672 19994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:26.511797 19994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "70c8004eb6d445c88b2d2159b65d9504"
format_stamp: "Formatted at 2026-08-07 06:43:26 on dist-test-slave-8hhm"
server_key: "8458bbfbf6a0ab019748f99cc1540d7c"
server_key_iv: "aa96f26dbeacef69e863f17e061f3691"
server_key_version: "encryptionkey@0"
I20260807 06:43:26.511873 19994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:26.536074 19994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:26.536384 19994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:26.536538 19994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:26.540983 19994 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:38851
I20260807 06:43:26.541028 20107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:38851 every 8 connection(s)
I20260807 06:43:26.541404 19994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:26.542387 20109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:26.544675 20109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504: Bootstrap starting.
I20260807 06:43:26.545296 20109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:26.545581 20109 log.cc:824] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:26.546221 20109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504: No bootstrap required, opened a new log
I20260807 06:43:26.547827 20109 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70c8004eb6d445c88b2d2159b65d9504" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38851 } }
I20260807 06:43:26.547969 20109 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:26.547991 20109 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c8004eb6d445c88b2d2159b65d9504, State: Initialized, Role: FOLLOWER
I20260807 06:43:26.548101 20109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70c8004eb6d445c88b2d2159b65d9504" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38851 } }
I20260807 06:43:26.548154 20109 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:26.548174 20109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:26.548202 20109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:26.548717 20109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70c8004eb6d445c88b2d2159b65d9504" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38851 } }
I20260807 06:43:26.548802 20109 leader_election.cc:302] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70c8004eb6d445c88b2d2159b65d9504; no voters:
I20260807 06:43:26.548923 20109 leader_election.cc:288] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:26.549011 20114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:26.549176 20114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [term 1 LEADER]: Becoming Leader. State: Replica: 70c8004eb6d445c88b2d2159b65d9504, State: Running, Role: LEADER
I20260807 06:43:26.549193 20109 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:26.549299 20114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70c8004eb6d445c88b2d2159b65d9504" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38851 } }
I20260807 06:43:26.549674 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 19994
I20260807 06:43:26.549799 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:26.549815 20116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70c8004eb6d445c88b2d2159b65d9504. Latest consensus state: current_term: 1 leader_uuid: "70c8004eb6d445c88b2d2159b65d9504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70c8004eb6d445c88b2d2159b65d9504" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38851 } } }
I20260807 06:43:26.549911 20116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:26.550052 11814 external_mini_cluster.cc:1428] Setting key ae7291d1dc8a812bbd62d3b6eb7e2756
I20260807 06:43:26.550269 20115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70c8004eb6d445c88b2d2159b65d9504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70c8004eb6d445c88b2d2159b65d9504" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38851 } } }
I20260807 06:43:26.550349 20115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:26.550639 20128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:26.551165 20128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:26.552778 20128 catalog_manager.cc:1347] Generated new cluster ID: 51eb9778ac1d4130af37767e8b4a5390
I20260807 06:43:26.552835 20128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:26.555922 20143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:26.550720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33426 (local address 127.11.137.190:38851)
0807 06:43:26.551034 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:26.551044 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:26.551084 (+ 40us) server_negotiation.cc:407] Connection header received
0807 06:43:26.551263 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:26.551271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:26.551358 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:26.551508 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:26.551739 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.553030 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.553871 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.554301 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.554439 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.555184 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:26.555187 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:26.555188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:26.555388 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:26.555421 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:26.555431 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:26.555512 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:26.555590 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 06:43:26.555764 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":68,"threads_started":1}
I20260807 06:43:26.556818 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:43:26.565243 20128 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:26.565734 20128 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:26.574756 20128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70c8004eb6d445c88b2d2159b65d9504: Generated new TSK 0
I20260807 06:43:26.574950 20128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:26.614586 20143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:26.580013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33442 (local address 127.11.137.190:38851)
0807 06:43:26.580069 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:26.580093 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:26.580184 (+ 91us) server_negotiation.cc:407] Connection header received
0807 06:43:26.580261 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:26.580262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:26.580277 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:26.580358 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:43:26.580507 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.580983 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.581849 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.582039 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.582151 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.582350 (+ 199us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:43:26.614303 (+ 31953us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 06:43:26.614496 (+ 193us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33442: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":32}
W20260807 06:43:26.614667 20143 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33442: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 06:43:26.614723 20157 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:26.579938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:38851 (local address 127.0.0.1:33442)
0807 06:43:26.580110 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:26.580122 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:26.580192 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:26.580358 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:26.580359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:26.580361 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:43:26.580421 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:26.580423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.581072 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.581073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:26.581758 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:26.581761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:26.582159 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:26.582160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:26.582219 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:26.582224 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:43:26.614476 (+ 32252us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 06:43:26.614609 (+ 133us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.137.190:38851: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260807 06:43:26.615060 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 19994
2026-08-07T06:43:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (231 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (89 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:26 dist-test-slave-8hhm krb5kdc[20176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:26 dist-test-slave-8hhm krb5kdc[20176](info): set up 2 sockets
Aug 07 06:43:26 dist-test-slave-8hhm krb5kdc[20176](info): commencing operation
krb5kdc: starting...
W20260807 06:43:28.044513 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:28.167512 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36017
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:36017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:28.249429 20196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:28.249615 20196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:28.249637 20196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:28.250785 20196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:28.250828 20196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:28.250841 20196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:28.250854 20196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:28.250903 20196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:28.252425 20196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:36017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:28.252667 20196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:28.252882 20196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:28.257604 20207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:28.257741 20196 server_base.cc:1034] running on GCE node
W20260807 06:43:28.257622 20208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.257824 20211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:28.258076 20196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:28.258397 20196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:28.259574 20196 hybrid_clock.cc:648] HybridClock initialized: now 1786085008259558 us; error 27 us; skew 500 ppm
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.266345 20196 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:28.266834 20196 webserver.cc:460] Webserver started at http://127.11.137.190:34537/ using document root <none> and password file <none>
I20260807 06:43:28.267099 20196 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:28.267172 20196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:28.267319 20196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:28.268322 20196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "336e3428049a413bacfbcb3f0ad7be4e"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "1775506be9442a44c6308105d3297ca1"
server_key_iv: "0770dade6384788b03f67c6e88a332d4"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.268687 20196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "336e3428049a413bacfbcb3f0ad7be4e"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "1775506be9442a44c6308105d3297ca1"
server_key_iv: "0770dade6384788b03f67c6e88a332d4"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.270040 20196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:28.270748 20224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.270967 20196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:28.271050 20196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "336e3428049a413bacfbcb3f0ad7be4e"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "1775506be9442a44c6308105d3297ca1"
server_key_iv: "0770dade6384788b03f67c6e88a332d4"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.271106 20196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:28.289637 20196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:28.291486 20196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:28.291590 20196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:28.295526 20196 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:36017
I20260807 06:43:28.295578 20305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:36017 every 8 connection(s)
I20260807 06:43:28.295938 20196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:28.296847 20306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:28.299194 20306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e: Bootstrap starting.
I20260807 06:43:28.299801 20306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:28.300110 20306 log.cc:824] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:28.300791 20306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e: No bootstrap required, opened a new log
I20260807 06:43:28.302551 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 20196
I20260807 06:43:28.302646 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:28.302524 20306 raft_consensus.cc:348] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "336e3428049a413bacfbcb3f0ad7be4e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36017 } }
I20260807 06:43:28.302729 20306 raft_consensus.cc:374] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:28.302804 20306 raft_consensus.cc:729] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 336e3428049a413bacfbcb3f0ad7be4e, State: Initialized, Role: FOLLOWER
I20260807 06:43:28.302929 11814 external_mini_cluster.cc:1428] Setting key 3d5f7a41c36e006eec1aab2ff903568b
I20260807 06:43:28.302980 20306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "336e3428049a413bacfbcb3f0ad7be4e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36017 } }
I20260807 06:43:28.303078 20306 raft_consensus.cc:388] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:28.303119 20306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:28.303160 20306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:28.303859 20306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "336e3428049a413bacfbcb3f0ad7be4e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36017 } }
I20260807 06:43:28.303989 20306 leader_election.cc:302] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 336e3428049a413bacfbcb3f0ad7be4e; no voters:
I20260807 06:43:28.304188 20306 leader_election.cc:288] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:28.304226 20315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:28.304383 20315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [term 1 LEADER]: Becoming Leader. State: Replica: 336e3428049a413bacfbcb3f0ad7be4e, State: Running, Role: LEADER
I20260807 06:43:28.304445 20306 sys_catalog.cc:564] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:28.304550 20315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "336e3428049a413bacfbcb3f0ad7be4e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36017 } }
I20260807 06:43:28.305001 20317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 336e3428049a413bacfbcb3f0ad7be4e. Latest consensus state: current_term: 1 leader_uuid: "336e3428049a413bacfbcb3f0ad7be4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "336e3428049a413bacfbcb3f0ad7be4e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36017 } } }
I20260807 06:43:28.305095 20317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:28.305342 20316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "336e3428049a413bacfbcb3f0ad7be4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "336e3428049a413bacfbcb3f0ad7be4e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36017 } } }
I20260807 06:43:28.305450 20316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:28.305640 20329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:28.306187 20329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:28.308426 20329 catalog_manager.cc:1347] Generated new cluster ID: f0a3c25bbf0e41cc8c21fc72deec7820
I20260807 06:43:28.308531 20329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:28.314663 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.303454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36514 (local address 127.11.137.190:36017)
0807 06:43:28.304041 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.304052 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.304090 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:43:28.304198 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.304203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.304269 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.304402 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.305145 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.306560 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.307602 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.308185 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.308311 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.310753 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.310757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.310758 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.310769 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.313073 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.313478 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.313481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.313482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.313584 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.313814 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.313815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.313815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.314060 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.314266 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.314334 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.314479 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":464,"threads_started":1}
I20260807 06:43:28.319782 20329 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:28.320523 20329 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:28.327152 20329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 336e3428049a413bacfbcb3f0ad7be4e: Generated new TSK 0
I20260807 06:43:28.327311 20329 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:28.357947 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36017
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:28.439023 20349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:28.439253 20349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:28.439292 20349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:28.440438 20349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:28.440505 20349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:28.440550 20349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:28.442063 20349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:28.442332 20349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:28.442564 20349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:28.447754 20357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.447711 20359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.447711 20356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:28.448189 20349 server_base.cc:1034] running on GCE node
I20260807 06:43:28.448437 20349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:28.448681 20349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:28.449867 20349 hybrid_clock.cc:648] HybridClock initialized: now 1786085008449851 us; error 34 us; skew 500 ppm
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.452389 20349 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:28.452842 20349 webserver.cc:460] Webserver started at http://127.11.137.129:36013/ using document root <none> and password file <none>
I20260807 06:43:28.453079 20349 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:28.453152 20349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:28.453346 20349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:28.454411 20349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "7c625005a6294af79b3de25907f36143"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "729ac1091d687bd35170e3cf99e298d4"
server_key_iv: "0f69c4adf6e1c4b73caeedd8d629f461"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.454798 20349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "7c625005a6294af79b3de25907f36143"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "729ac1091d687bd35170e3cf99e298d4"
server_key_iv: "0f69c4adf6e1c4b73caeedd8d629f461"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.456135 20349 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:28.456881 20368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.457063 20349 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:28.457165 20349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "7c625005a6294af79b3de25907f36143"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "729ac1091d687bd35170e3cf99e298d4"
server_key_iv: "0f69c4adf6e1c4b73caeedd8d629f461"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.457276 20349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:28.468081 20349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:28.469925 20349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:28.470083 20349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:28.470325 20349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:28.470628 20349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:28.470685 20349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.470726 20349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:28.470754 20349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.476759 20349 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:36733
I20260807 06:43:28.476832 20545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:36733 every 8 connection(s)
I20260807 06:43:28.477141 20349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:28.482963 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 20349
I20260807 06:43:28.483098 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:28.483314 11814 external_mini_cluster.cc:1428] Setting key 58b0eb23374251f97b5ac9e5b3c8b2fe
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:28.487353 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.477893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:33043 (local address 127.11.137.190:36017)
0807 06:43:28.477959 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.477961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.478151 (+ 190us) server_negotiation.cc:407] Connection header received
0807 06:43:28.479202 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.479203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.479218 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.479267 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.479877 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.480389 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.481457 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.481714 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.481801 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.484127 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.484128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.484128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.484140 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.485835 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.486395 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.486396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.486397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.486453 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.486734 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.486734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.486735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.486834 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.486884 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.487224 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.487290 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:43:28.487640 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.477879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36017 (local address 127.11.137.129:33043)
0807 06:43:28.478037 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:28.478071 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:28.479089 (+ 1018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:28.479331 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:28.479334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:28.479583 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:28.479776 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:28.479781 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.480497 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.480498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:28.481354 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:28.481357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.481815 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.481816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:28.481941 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.482386 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:28.482394 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:28.484025 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:28.485927 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:28.485936 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:28.485938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:28.486306 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:28.486517 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:28.486518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:28.486518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:28.486665 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:28.486898 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:28.486905 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:28.487073 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 06:43:28.487201 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 06:43:28.487386 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260807 06:43:28.488209 20547 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36017
I20260807 06:43:28.488300 20547 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:28.488483 20547 heartbeater.cc:511] Master 127.11.137.190:36017 requested a full tablet report, sending...
I20260807 06:43:28.489032 20248 ts_manager.cc:194] Registered new tserver with Master: 7c625005a6294af79b3de25907f36143 (127.11.137.129:36733)
I20260807 06:43:28.489650 20248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:33043
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:28.510123 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36017
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:28.591158 20555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:28.591365 20555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:28.591388 20555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:28.592473 20555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:28.592510 20555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:28.592535 20555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:28.593957 20555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:28.594141 20555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:28.594308 20555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:28.599188 20565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.599203 20569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.599205 20566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:28.599603 20555 server_base.cc:1034] running on GCE node
I20260807 06:43:28.599852 20555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:28.600085 20555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:28.601312 20555 hybrid_clock.cc:648] HybridClock initialized: now 1786085008601300 us; error 33 us; skew 500 ppm
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.603946 20555 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:28.604401 20555 webserver.cc:460] Webserver started at http://127.11.137.130:38397/ using document root <none> and password file <none>
I20260807 06:43:28.604673 20555 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:28.604722 20555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:28.604810 20555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:28.605950 20555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "584b0462d9414d54be7ad02ca5eaf39a"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "8f87ac11f4f53f5649163a7dfebc6fe9"
server_key_iv: "d40fce13ae4f6fee0978d92d005ff249"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.606252 20555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "584b0462d9414d54be7ad02ca5eaf39a"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "8f87ac11f4f53f5649163a7dfebc6fe9"
server_key_iv: "d40fce13ae4f6fee0978d92d005ff249"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.607591 20555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:28.608294 20579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.608467 20555 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:28.608541 20555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "584b0462d9414d54be7ad02ca5eaf39a"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "8f87ac11f4f53f5649163a7dfebc6fe9"
server_key_iv: "d40fce13ae4f6fee0978d92d005ff249"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.608592 20555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:28.621903 20555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:28.624121 20555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:28.624235 20555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:28.624395 20555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:28.624632 20555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:28.624662 20555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.624682 20555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:28.624696 20555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.630457 20555 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:39105
I20260807 06:43:28.630522 20763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:39105 every 8 connection(s)
I20260807 06:43:28.630792 20555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:28.635056 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 20555
I20260807 06:43:28.635200 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:28.635396 11814 external_mini_cluster.cc:1428] Setting key a5ad863bdedf157c633c1057d49645c3
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:28.640936 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.631443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:46759 (local address 127.11.137.190:36017)
0807 06:43:28.631488 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.631490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.631746 (+ 256us) server_negotiation.cc:407] Connection header received
0807 06:43:28.632692 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.632694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.632708 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.632764 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.633419 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.633906 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.634921 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.635125 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.635199 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.637866 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.637867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.637867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.637873 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.639533 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.639929 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.639930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.639930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.640006 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.640237 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.640238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.640238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.640386 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.640456 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.640701 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.640799 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:28.640937 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.631433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36017 (local address 127.11.137.130:46759)
0807 06:43:28.631618 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:28.631651 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:28.632572 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:28.632846 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:28.632854 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:28.633088 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:28.633327 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:28.633332 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.634002 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.634004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:28.634797 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:28.634799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.635219 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.635220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:28.635398 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.635941 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:28.635950 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:28.637762 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:28.639613 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:28.639619 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:28.639621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:28.639842 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:28.640075 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:28.640076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:28.640076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:28.640173 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:28.640450 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:28.640455 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:28.640560 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 06:43:28.640637 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 06:43:28.640758 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260807 06:43:28.641542 20764 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36017
I20260807 06:43:28.641644 20764 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:28.641831 20764 heartbeater.cc:511] Master 127.11.137.190:36017 requested a full tablet report, sending...
I20260807 06:43:28.642264 20248 ts_manager.cc:194] Registered new tserver with Master: 584b0462d9414d54be7ad02ca5eaf39a (127.11.137.130:39105)
I20260807 06:43:28.642632 20248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:46759
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:28.662340 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36017
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:28.743857 20773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:28.744048 20773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:28.744072 20773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:28.745260 20773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:28.745311 20773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:28.745337 20773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:28.746878 20773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:28.747066 20773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:28.747313 20773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:28.752308 20781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.752297 20780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:28.752296 20784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:28.752442 20773 server_base.cc:1034] running on GCE node
I20260807 06:43:28.752761 20773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:28.752993 20773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:28.754158 20773 hybrid_clock.cc:648] HybridClock initialized: now 1786085008754125 us; error 45 us; skew 500 ppm
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.756620 20773 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:28.757103 20773 webserver.cc:460] Webserver started at http://127.11.137.131:36409/ using document root <none> and password file <none>
I20260807 06:43:28.757377 20773 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:28.757458 20773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:28.757591 20773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:28.758569 20773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "4d44304b21d24909a978777cc152f52c"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "05a29874557d2484517a9903f2e3f37a"
server_key_iv: "226ebf4d4b64e641f797ce056a0e2802"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.758945 20773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "4d44304b21d24909a978777cc152f52c"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "05a29874557d2484517a9903f2e3f37a"
server_key_iv: "226ebf4d4b64e641f797ce056a0e2802"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.760344 20773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:28.761041 20794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.761297 20773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:28.761376 20773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "4d44304b21d24909a978777cc152f52c"
format_stamp: "Formatted at 2026-08-07 06:43:28 on dist-test-slave-8hhm"
server_key: "05a29874557d2484517a9903f2e3f37a"
server_key_iv: "226ebf4d4b64e641f797ce056a0e2802"
server_key_version: "encryptionkey@0"
I20260807 06:43:28.761464 20773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:28.773598 20773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:28.775439 20773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:28.775578 20773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:28.775830 20773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:28.776119 20773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:28.776152 20773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.776202 20773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:28.776230 20773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:28.782425 20773 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:40737
I20260807 06:43:28.782467 20980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:40737 every 8 connection(s)
I20260807 06:43:28.782757 20773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:28.787048 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 20773
I20260807 06:43:28.787123 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:28.787333 11814 external_mini_cluster.cc:1428] Setting key 2f88b25e7f570eae7b50b329d8c9d950
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:28.791981 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.783497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:37365 (local address 127.11.137.190:36017)
0807 06:43:28.783549 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.783551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.783784 (+ 233us) server_negotiation.cc:407] Connection header received
0807 06:43:28.784757 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.784758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.784771 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.784833 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.785499 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.785993 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.787007 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.787244 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.787331 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.789668 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.789670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.789670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.789677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.790785 (+ 1108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.791187 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.791188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.791188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.791239 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.791456 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.791457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.791457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.791553 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.791603 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.791856 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.791918 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:43:28.792150 20983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.783478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36017 (local address 127.11.137.131:37365)
0807 06:43:28.783659 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:28.783693 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:28.784638 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:28.784902 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:28.784906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:28.785201 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:28.785394 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:28.785398 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.786101 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.786102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:28.786912 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:28.786914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.787343 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.787344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:28.787488 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.788078 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:28.788088 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:28.789588 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:28.790874 (+ 1286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:28.790880 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:28.790881 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:28.791107 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:28.791300 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:28.791301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:28.791301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:28.791402 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:28.791611 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:28.791616 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:28.791742 (+ 126us) client_negotiation.cc:769] Sending connection context
0807 06:43:28.791824 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:43:28.791940 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260807 06:43:28.792634 20981 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36017
I20260807 06:43:28.792742 20981 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:28.792914 20981 heartbeater.cc:511] Master 127.11.137.190:36017 requested a full tablet report, sending...
I20260807 06:43:28.793331 20248 ts_manager.cc:194] Registered new tserver with Master: 4d44304b21d24909a978777cc152f52c (127.11.137.131:40737)
I20260807 06:43:28.793705 20248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:37365
I20260807 06:43:28.799171 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/test-admin.keytab.
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.815837 11814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 06:43:28.817444 20997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:28.816653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44624 (local address 127.11.137.129:36733)
0807 06:43:28.816845 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.816849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.816859 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:28.816886 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.816888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.816902 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.816969 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.817348 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44624: BlockingRecv error: recv got EOF from 127.0.0.1:44624 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":109,"threads_started":1}
W20260807 06:43:28.817483 11814 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.818473 11814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.819366 11814 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:28.826839 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.819835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44640 (local address 127.11.137.129:36733)
0807 06:43:28.819879 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.819880 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.819904 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:43:28.819957 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.819957 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.819965 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.820022 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.820437 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.821168 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.821934 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.822243 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.822299 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.824384 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.824391 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.824391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.824397 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.825873 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.826189 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.826192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.826192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.826246 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.826407 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.826408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.826408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.826530 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.826628 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.826707 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.826766 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:43:28.828740 20997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:28.828250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44642 (local address 127.11.137.129:36733)
0807 06:43:28.828308 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.828310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.828333 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:43:28.828395 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.828396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.828405 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.828451 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.828700 (+ 249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44642: BlockingRecv error: recv got EOF from 127.0.0.1:44642 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 06:43:28.828811 11814 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.829805 11814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.830627 11814 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:28.837138 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.831195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44658 (local address 127.11.137.129:36733)
0807 06:43:28.831235 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.831236 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.831268 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:43:28.831316 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.831317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.831325 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.831369 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.831687 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.832146 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.832773 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.832984 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.833033 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.834934 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.834936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.834936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.834943 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.836104 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.836427 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.836428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.836428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.836484 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.836682 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.836683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.836683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.836775 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.836866 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.836981 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.837048 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:43:28.838644 20997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:28.838109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.11.137.129:36733)
0807 06:43:28.838145 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.838147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.838204 (+ 57us) server_negotiation.cc:407] Connection header received
0807 06:43:28.838224 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.838225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.838232 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.838275 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.838586 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44660: BlockingRecv error: recv got EOF from 127.0.0.1:44660 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 06:43:28.838768 11814 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786084979847518-11814-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.839612 11814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:28.840709 11814 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[20176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:43:28.847287 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:28.841366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44668 (local address 127.11.137.129:36733)
0807 06:43:28.841405 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:28.841406 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:28.841461 (+ 55us) server_negotiation.cc:407] Connection header received
0807 06:43:28.841502 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:28.841503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:28.841510 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:28.841555 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:28.841911 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.842350 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.842964 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:28.843129 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:28.843175 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:28.845100 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:28.845101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:28.845102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:28.845107 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:28.846455 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.846740 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.846741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.846741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.846789 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:28.846933 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:28.846934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:28.846934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:28.847007 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:28.847069 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:28.847150 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 06:43:28.847203 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:28.847932 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 20349
I20260807 06:43:28.860252 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 20555
I20260807 06:43:28.874382 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 20773
I20260807 06:43:28.885406 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 20196
2026-08-07T06:43:28Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2088 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[21020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[21020](info): set up 2 sockets
Aug 07 06:43:28 dist-test-slave-8hhm krb5kdc[21020](info): commencing operation
krb5kdc: starting...
W20260807 06:43:30.129490 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab.
Entry for principal oryx/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab.
I20260807 06:43:30.247838 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:34065
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab
--principal=oryx/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:34065
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:30.328183 21042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:30.328374 21042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:30.328397 21042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:30.329468 21042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:30.329502 21042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:30.329516 21042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:30.329530 21042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:30.329541 21042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:30.330957 21042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:34065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab
--principal=oryx/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:34065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:30.331144 21042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:30.331296 21042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:30.336263 21048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.336273 21055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.336328 21052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:30.336709 21042 server_base.cc:1034] running on GCE node
I20260807 06:43:30.336973 21042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:30.337199 21042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:30.338411 21042 hybrid_clock.cc:648] HybridClock initialized: now 1786085010338392 us; error 39 us; skew 500 ppm
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:30.340965 21042 init.cc:377] Logged in from keytab as oryx/127.11.137.190@KRBTEST.COM (short username oryx)
I20260807 06:43:30.341452 21042 webserver.cc:460] Webserver started at http://127.11.137.190:34647/ using document root <none> and password file <none>
I20260807 06:43:30.341719 21042 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:30.341789 21042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:30.341931 21042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:30.343003 21042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "c421ce05bb7446dda6d5ef7ab297f1bb"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "08845bc9fb6baa9095560b476e74612c"
server_key_iv: "6ad9c7f522e88e9c3acd2edcf5010b50"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.343382 21042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "c421ce05bb7446dda6d5ef7ab297f1bb"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "08845bc9fb6baa9095560b476e74612c"
server_key_iv: "6ad9c7f522e88e9c3acd2edcf5010b50"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.344719 21042 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:43:30.345474 21070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.345661 21042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:30.345767 21042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "c421ce05bb7446dda6d5ef7ab297f1bb"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "08845bc9fb6baa9095560b476e74612c"
server_key_iv: "6ad9c7f522e88e9c3acd2edcf5010b50"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.345847 21042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:30.369414 21042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:30.371812 21042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:30.371985 21042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:30.376314 21042 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:34065
I20260807 06:43:30.376353 21157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:34065 every 8 connection(s)
I20260807 06:43:30.376718 21042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:30.377715 21162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:30.379904 21162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Bootstrap starting.
I20260807 06:43:30.380425 21162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:30.380668 21162 log.cc:824] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:30.381410 21162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: No bootstrap required, opened a new log
I20260807 06:43:30.382424 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 21042
I20260807 06:43:30.382539 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:30.382772 11814 external_mini_cluster.cc:1428] Setting key 22ae71e3d14180babf7c216d445e4b06
I20260807 06:43:30.383595 21162 raft_consensus.cc:348] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } }
I20260807 06:43:30.383754 21162 raft_consensus.cc:374] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:30.383862 21162 raft_consensus.cc:729] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c421ce05bb7446dda6d5ef7ab297f1bb, State: Initialized, Role: FOLLOWER
I20260807 06:43:30.384037 21162 consensus_queue.cc:260] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } }
I20260807 06:43:30.384138 21162 raft_consensus.cc:388] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:30.384172 21162 raft_consensus.cc:482] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:30.384246 21162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:30.384881 21162 raft_consensus.cc:504] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } }
I20260807 06:43:30.385005 21162 leader_election.cc:302] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c421ce05bb7446dda6d5ef7ab297f1bb; no voters:
I20260807 06:43:30.385185 21162 leader_election.cc:288] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:30.385250 21169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:30.385409 21169 raft_consensus.cc:686] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 LEADER]: Becoming Leader. State: Replica: c421ce05bb7446dda6d5ef7ab297f1bb, State: Running, Role: LEADER
I20260807 06:43:30.385464 21162 sys_catalog.cc:564] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:30.385542 21169 consensus_queue.cc:237] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } }
I20260807 06:43:30.386003 21171 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } }
I20260807 06:43:30.386098 21171 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:30.386332 21172 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c421ce05bb7446dda6d5ef7ab297f1bb. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } }
I20260807 06:43:30.386461 21172 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:30.386618 21182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:30.387195 21182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:30.388827 21182 catalog_manager.cc:1347] Generated new cluster ID: a372f9535f8d450fb7f86c62b0fb569d
I20260807 06:43:30.388880 21182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:30.394191 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.383300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43092 (local address 127.11.137.190:34065)
0807 06:43:30.383479 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:30.383486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:30.383511 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:43:30.383615 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:30.383621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:30.383660 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:30.383818 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:30.384567 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.385786 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.386945 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.387532 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.387653 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.390471 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:30.390475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:30.390475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:30.390486 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:30.392418 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.392828 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.392830 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.392831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.392954 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.393177 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.393177 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.393178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.393476 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:30.393642 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:30.393764 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 06:43:30.393892 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260807 06:43:30.396380 21182 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:30.396869 21182 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:30.404548 21182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Generated new TSK 0
I20260807 06:43:30.404704 21182 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab.
Entry for principal oryx/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab.
I20260807 06:43:30.439486 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:34065
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:30.520599 21201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:30.520789 21201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:30.520812 21201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:30.521948 21201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:30.521988 21201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:30.522042 21201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:30.523468 21201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:34065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:30.523696 21201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:30.523910 21201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:30.528944 21212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.528916 21210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.528924 21208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:30.529240 21201 server_base.cc:1034] running on GCE node
I20260807 06:43:30.529436 21201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:30.529695 21201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:30.530866 21201 hybrid_clock.cc:648] HybridClock initialized: now 1786085010530851 us; error 30 us; skew 500 ppm
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:30.533481 21201 init.cc:377] Logged in from keytab as oryx/127.11.137.129@KRBTEST.COM (short username oryx)
I20260807 06:43:30.533879 21201 webserver.cc:460] Webserver started at http://127.11.137.129:41317/ using document root <none> and password file <none>
I20260807 06:43:30.534101 21201 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:30.534193 21201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:30.534340 21201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:30.535370 21201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "7be4cfd90afd47558e892c1e39bfb46f"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "51b83933ff763127aad8f55d8eba9951"
server_key_iv: "dd2778ad2fd84819e55cc117622b0457"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.535748 21201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "7be4cfd90afd47558e892c1e39bfb46f"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "51b83933ff763127aad8f55d8eba9951"
server_key_iv: "dd2778ad2fd84819e55cc117622b0457"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.537042 21201 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:30.537883 21225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.538059 21201 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:30.538174 21201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "7be4cfd90afd47558e892c1e39bfb46f"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "51b83933ff763127aad8f55d8eba9951"
server_key_iv: "dd2778ad2fd84819e55cc117622b0457"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.538260 21201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:30.554500 21201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:30.556232 21201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:30.556381 21201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:30.556598 21201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:30.556891 21201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:30.556943 21201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.556984 21201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:30.557011 21201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.563035 21201 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:36981
I20260807 06:43:30.563083 21400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:36981 every 8 connection(s)
I20260807 06:43:30.563367 21201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:30.564708 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 21201
I20260807 06:43:30.564833 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:30.565049 11814 external_mini_cluster.cc:1428] Setting key 7b921319d55c1b0d80f2df77a490b37b
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:30.573690 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.564024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:54903 (local address 127.11.137.190:34065)
0807 06:43:30.564090 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:30.564092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:30.564337 (+ 245us) server_negotiation.cc:407] Connection header received
0807 06:43:30.564817 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:30.564819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:30.564838 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:30.564911 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:30.566140 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.566890 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.568093 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.568295 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.568350 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.570714 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:30.570716 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:30.570716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:30.570728 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:30.572169 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.572606 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.572607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.572608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.572670 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.572941 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.572942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.572943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.573093 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:30.573182 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:30.573494 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 06:43:30.573588 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:43:30.573848 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.564001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:54903)
0807 06:43:30.564215 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:30.564250 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:30.564711 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:30.565004 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:30.565009 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:30.565790 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:30.566034 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:30.566039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.566979 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.566980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:30.567999 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:30.568002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.568378 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.568379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:30.568521 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.569011 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:30.569020 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:30.570596 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:30.572274 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:30.572282 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:30.572284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:30.572511 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:30.572754 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:30.572755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:30.572755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:30.572865 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:30.573174 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:30.573191 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:30.573357 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 06:43:30.573469 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 06:43:30.573622 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":121,"threads_started":1}
I20260807 06:43:30.574347 21401 heartbeater.cc:347] Connected to a master server at 127.11.137.190:34065
WARNING: no policy specified for oryx/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:43:30.574460 21401 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:30.574659 21401 heartbeater.cc:511] Master 127.11.137.190:34065 requested a full tablet report, sending...
I20260807 06:43:30.575170 21095 ts_manager.cc:194] Registered new tserver with Master: 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:30.575920 21095 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:54903
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab.
Entry for principal oryx/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab.
I20260807 06:43:30.591825 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:34065
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:30.673588 21411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:30.673779 21411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:30.673801 21411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:30.674921 21411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:30.674961 21411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:30.674988 21411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:30.676441 21411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:34065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:30.676687 21411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:30.676913 21411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:30.681845 21418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:30.681957 21411 server_base.cc:1034] running on GCE node
W20260807 06:43:30.682057 21420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.681834 21424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:30.682308 21411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:30.682549 21411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:30.683702 21411 hybrid_clock.cc:648] HybridClock initialized: now 1786085010683686 us; error 34 us; skew 500 ppm
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:30.686353 21411 init.cc:377] Logged in from keytab as oryx/127.11.137.130@KRBTEST.COM (short username oryx)
I20260807 06:43:30.686842 21411 webserver.cc:460] Webserver started at http://127.11.137.130:38049/ using document root <none> and password file <none>
I20260807 06:43:30.687021 21411 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:30.687062 21411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:30.687151 21411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:30.688133 21411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "fc66669b33f64094b9106b8703a7a959"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "9124b89f2b6827636c8d175f08441bed"
server_key_iv: "aa328cfbbdc1032f3d5b9d863844924b"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.688431 21411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "fc66669b33f64094b9106b8703a7a959"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "9124b89f2b6827636c8d175f08441bed"
server_key_iv: "aa328cfbbdc1032f3d5b9d863844924b"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.689774 21411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:30.690450 21438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.690655 21411 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:30.690732 21411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "fc66669b33f64094b9106b8703a7a959"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "9124b89f2b6827636c8d175f08441bed"
server_key_iv: "aa328cfbbdc1032f3d5b9d863844924b"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.690822 21411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:30.703965 21411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:30.705834 21411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:30.705981 21411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:30.706198 21411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:30.706493 21411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:30.706527 21411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.706566 21411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:30.706604 21411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.712507 21411 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:35711
I20260807 06:43:30.712563 21620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:35711 every 8 connection(s)
I20260807 06:43:30.712857 21411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:30.717082 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 21411
I20260807 06:43:30.717199 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:30.717432 11814 external_mini_cluster.cc:1428] Setting key bb0e92b501420d4946a73d75226e31c7
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:30.723050 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.713604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:45705 (local address 127.11.137.190:34065)
0807 06:43:30.713647 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:30.713649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:30.713865 (+ 216us) server_negotiation.cc:407] Connection header received
0807 06:43:30.714329 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:30.714330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:30.714340 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:30.714395 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:30.715306 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.715797 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.716896 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.717258 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.717339 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.719936 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:30.719937 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:30.719938 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:30.719944 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:30.721513 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.722099 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.722099 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.722100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.722155 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.722441 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.722442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.722442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.722538 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:30.722597 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:30.722911 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 06:43:30.722976 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:43:30.723392 21623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.713569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:45705)
0807 06:43:30.713732 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:30.713773 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:30.714249 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:30.714446 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:30.714448 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:30.715046 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:30.715227 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:30.715232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.715877 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.715878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:30.716771 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:30.716774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.717348 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.717349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:30.717451 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.718026 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:30.718036 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:30.719848 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:30.721636 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:30.721644 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:30.721646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:30.722015 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:30.722225 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:30.722226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:30.722226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:30.722375 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:30.722603 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:30.722610 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:30.722766 (+ 156us) client_negotiation.cc:769] Sending connection context
0807 06:43:30.722888 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 06:43:30.723096 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260807 06:43:30.723917 21621 heartbeater.cc:347] Connected to a master server at 127.11.137.190:34065
I20260807 06:43:30.724021 21621 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:30.724210 21621 heartbeater.cc:511] Master 127.11.137.190:34065 requested a full tablet report, sending...
I20260807 06:43:30.724640 21095 ts_manager.cc:194] Registered new tserver with Master: fc66669b33f64094b9106b8703a7a959 (127.11.137.130:35711)
I20260807 06:43:30.725183 21095 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:45705
WARNING: no policy specified for oryx/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab.
Entry for principal oryx/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab.
I20260807 06:43:30.743983 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:34065
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:30.825148 21628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:30.825385 21628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:30.825425 21628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:30.826551 21628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:30.826637 21628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:30.826682 21628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:30.828163 21628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:34065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:30.828410 21628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:30.828651 21628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:43:30.833786 21628 server_base.cc:1034] running on GCE node
W20260807 06:43:30.833750 21642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.833755 21636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.833763 21638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:30.834221 21628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:30.834475 21628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:30.835660 21628 hybrid_clock.cc:648] HybridClock initialized: now 1786085010835637 us; error 37 us; skew 500 ppm
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:30.838263 21628 init.cc:377] Logged in from keytab as oryx/127.11.137.131@KRBTEST.COM (short username oryx)
I20260807 06:43:30.838716 21628 webserver.cc:460] Webserver started at http://127.11.137.131:40633/ using document root <none> and password file <none>
I20260807 06:43:30.838969 21628 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:30.839037 21628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:30.839213 21628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:30.840247 21628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "ea9543ab11c84129891983da282c6496"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "c8c892b73456f386078258e2d85aeb4a"
server_key_iv: "4dd36f5be72399fffe29929a799a730a"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.840610 21628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "ea9543ab11c84129891983da282c6496"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "c8c892b73456f386078258e2d85aeb4a"
server_key_iv: "4dd36f5be72399fffe29929a799a730a"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.842103 21628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:30.842834 21652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.843008 21628 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:30.843132 21628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "ea9543ab11c84129891983da282c6496"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "c8c892b73456f386078258e2d85aeb4a"
server_key_iv: "4dd36f5be72399fffe29929a799a730a"
server_key_version: "encryptionkey@0"
I20260807 06:43:30.843211 21628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:30.850003 21628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:30.851728 21628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:30.851903 21628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:30.852126 21628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:30.852417 21628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:30.852473 21628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.852515 21628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:30.852543 21628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:30.858497 21628 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:40247
I20260807 06:43:30.858575 21832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:40247 every 8 connection(s)
I20260807 06:43:30.858881 21628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:30.867784 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.859639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:43217 (local address 127.11.137.190:34065)
0807 06:43:30.859713 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:30.859715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:30.859898 (+ 183us) server_negotiation.cc:407] Connection header received
0807 06:43:30.860385 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:30.860386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:30.860395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:30.860451 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:30.861357 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.861828 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.862768 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.862947 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.862995 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.864957 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:30.864959 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:30.864959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:30.864966 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:30.866349 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.866773 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.866774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.866775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.866837 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:30.867115 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:30.867116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:30.867116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:30.867234 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:30.867312 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:30.867606 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 06:43:30.867694 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:43:30.867928 21836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:30.859619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:43217)
0807 06:43:30.859772 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:30.859813 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:30.860304 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:30.860499 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:30.860502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:30.861033 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:30.861269 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:30.861276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.861903 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.861904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:30.862694 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:30.862696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:30.863016 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:30.863017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:30.863133 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:30.863559 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:30.863567 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:30.864876 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:30.866441 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:30.866448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:30.866450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:30.866677 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:30.866907 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:30.866908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:30.866908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:30.867017 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:30.867303 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:30.867311 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:30.867454 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 06:43:30.867559 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 06:43:30.867710 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260807 06:43:30.868491 21834 heartbeater.cc:347] Connected to a master server at 127.11.137.190:34065
I20260807 06:43:30.868585 21834 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:30.868785 21834 heartbeater.cc:511] Master 127.11.137.190:34065 requested a full tablet report, sending...
I20260807 06:43:30.868827 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 21628
I20260807 06:43:30.868918 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:30.869102 11814 external_mini_cluster.cc:1428] Setting key e2e2b89d1e7cd9ac2da872c8f270c160
I20260807 06:43:30.869257 21095 ts_manager.cc:194] Registered new tserver with Master: ea9543ab11c84129891983da282c6496 (127.11.137.131:40247)
I20260807 06:43:30.869724 21095 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:43217
I20260807 06:43:30.870131 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.137.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.189.keytab.
Entry for principal oryx/127.11.137.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.189.keytab.
I20260807 06:43:30.898324 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:36759
--webserver_interface=127.11.137.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.189.keytab
--principal=oryx/127.11.137.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:34065,127.11.137.189:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:30.983496 21842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:30.983695 21842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:30.983718 21842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:30.985404 21842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:30.985505 21842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:30.985539 21842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:30.985558 21842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:30.985626 21842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:30.987676 21842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:34065,127.11.137.189:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.189.keytab
--principal=oryx/127.11.137.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:36759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.137.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
W20260807 06:43:30.987807 21842 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.137.190:34065,127.11.137.189:36759'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 06:43:30.987950 21842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:30.988197 21842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:30.993175 21850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.993155 21852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:30.993191 21856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:30.993523 21842 server_base.cc:1034] running on GCE node
I20260807 06:43:30.993804 21842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:30.994048 21842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:30.995220 21842 hybrid_clock.cc:648] HybridClock initialized: now 1786085010995203 us; error 51 us; skew 500 ppm
Aug 07 06:43:30 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:30.997767 21842 init.cc:377] Logged in from keytab as oryx/127.11.137.189@KRBTEST.COM (short username oryx)
I20260807 06:43:30.998237 21842 webserver.cc:460] Webserver started at http://127.11.137.189:33401/ using document root <none> and password file <none>
I20260807 06:43:30.998461 21842 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:30.998536 21842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:30.998680 21842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:30.999708 21842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/instance:
uuid: "864e0f1045e040e08daf450b3be9bbf5"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "55700b1eb4fc65d87a8bd4d444c54f53"
server_key_iv: "6694e1f392cdf3d5cc95faddaeebbe57"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.000087 21842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal/instance:
uuid: "864e0f1045e040e08daf450b3be9bbf5"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "55700b1eb4fc65d87a8bd4d444c54f53"
server_key_iv: "6694e1f392cdf3d5cc95faddaeebbe57"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.001540 21842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:31.002270 21865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.002446 21842 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:31.002562 21842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
uuid: "864e0f1045e040e08daf450b3be9bbf5"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "55700b1eb4fc65d87a8bd4d444c54f53"
server_key_iv: "6694e1f392cdf3d5cc95faddaeebbe57"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.002638 21842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.030961 21842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.032859 21842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:31.033062 21842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.037021 21842 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.189:36759
I20260807 06:43:31.037127 21948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.189:36759 every 8 connection(s)
I20260807 06:43:31.037456 21842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
I20260807 06:43:31.038537 21950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:31.040058 21950 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:43:31.044399 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 21842
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.189@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:31.049969 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.040761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43098 (local address 127.11.137.190:34065)
0807 06:43:31.040829 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.040833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.041050 (+ 217us) server_negotiation.cc:407] Connection header received
0807 06:43:31.041604 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.041620 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.041634 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.041692 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.042265 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.042763 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.043728 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.043904 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.043955 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.046622 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.046623 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.046624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.046631 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.048326 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.048859 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.048861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.048861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.048934 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.049275 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.049280 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.049280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.049423 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.049478 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.049840 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.049906 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:43:31.050197 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.040753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:43098)
0807 06:43:31.040931 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.040966 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.041501 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.041764 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.041767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.042007 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.042192 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.042196 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.042846 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.042847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.043654 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.043656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.044002 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.044003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.044120 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.044704 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.044712 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.046532 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.048399 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.048406 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.048409 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.048759 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.049014 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.049015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.049015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.049155 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.049494 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.049500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.049689 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.049802 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.049967 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
I20260807 06:43:31.050868 21950 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:43:31.054080 21958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.044932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55184 (local address 127.11.137.189:36759)
0807 06:43:31.045088 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.045093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.045165 (+ 72us) server_negotiation.cc:407] Connection header received
0807 06:43:31.045269 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.045271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.045294 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.045374 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.046094 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.047101 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.047798 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.048283 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.048365 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.051131 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.051138 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.051138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.051145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.052726 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.053126 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.053129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.053129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.053201 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.053432 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.053433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.053433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.053605 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.053774 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.053889 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.053980 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.189@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
I20260807 06:43:31.058117 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.051126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:55200)
0807 06:43:31.051308 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.051319 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.051368 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.051520 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.051520 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.051678 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.051734 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.051736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.052370 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.052371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.052887 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.052889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.053331 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.053332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.053411 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.053821 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.053826 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.055502 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.057059 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.057060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.057060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.057270 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.057487 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.057489 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.057489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.057547 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.057796 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.057797 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.057835 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.057913 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.058005 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260807 06:43:31.058203 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.051170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.11.137.189:36759)
0807 06:43:31.051321 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.051322 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.051354 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:43:31.051438 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.051439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.051449 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.051516 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.051822 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.052291 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.052964 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.053251 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.053307 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.055576 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.055577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.055577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.055583 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.056991 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.057358 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.057359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.057359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.057421 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.057617 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.057618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.057618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.057721 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.057792 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.057935 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.058056 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":131,"thread_start_us":107,"threads_started":1}
I20260807 06:43:31.059384 21950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Bootstrap starting.
I20260807 06:43:31.059952 21950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:31.060190 21950 log.cc:824] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:31.060851 21950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: No bootstrap required, opened a new log
I20260807 06:43:31.062270 21950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } }
I20260807 06:43:31.062389 21950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:31.062412 21950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 864e0f1045e040e08daf450b3be9bbf5, State: Initialized, Role: FOLLOWER
I20260807 06:43:31.062526 21950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } }
I20260807 06:43:31.062776 21961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } } }
I20260807 06:43:31.062839 21950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:31.062886 21961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 06:43:31.064385 21974 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:43:31.064445 21974 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:43:31.066202 21842 master_runner.cc:428] Detected that this master 864e0f1045e040e08daf450b3be9bbf5 is joining an existing cluster
I20260807 06:43:31.066272 21842 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.137.189:36759
I20260807 06:43:31.074445 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.067301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43112 (local address 127.11.137.190:34065)
0807 06:43:31.067344 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.067346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.067531 (+ 185us) server_negotiation.cc:407] Connection header received
0807 06:43:31.067602 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.067603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.067613 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.067663 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.068094 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.068861 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.069723 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.069973 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.070030 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.071181 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.071183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.071183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.071190 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.072872 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073389 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.073390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.073391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.073451 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073863 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.073864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.073864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.074006 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.074052 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.074272 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.074350 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:43:31.074450 21985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.067231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:43112)
0807 06:43:31.067452 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.067462 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.067544 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.067719 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.067720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.067937 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.068015 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.068017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.068945 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.068945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.069620 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.069622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.070097 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.070098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.070155 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.070661 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.070667 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.071076 (+ 409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.072968 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.072969 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.072970 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.073296 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.073712 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073712 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.073713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.073783 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.074101 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.074102 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.074143 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.074218 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.074339 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":38,"thread_start_us":162,"threads_started":1}
I20260807 06:43:31.074586 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.067310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:55214)
0807 06:43:31.067477 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.067487 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.067555 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.067734 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.067734 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.067976 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.068054 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.068057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.068937 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.068937 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.069878 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.069882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.070354 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.070355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.070450 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.070854 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.070859 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.071273 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.073103 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.073104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.073445 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.073687 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.073688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.073736 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.073976 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.073977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.074150 (+ 173us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.074241 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.074398 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":93,"thread_start_us":90,"threads_started":1}
I20260807 06:43:31.074708 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.067297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55214 (local address 127.11.137.189:36759)
0807 06:43:31.067333 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.067335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.067534 (+ 199us) server_negotiation.cc:407] Connection header received
0807 06:43:31.067641 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.067642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.067651 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.067726 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.068150 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.068850 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.069974 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.070268 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.070339 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.071363 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.071364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.071365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.071372 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.073024 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073527 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.073529 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.073529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.073610 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.073801 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.073802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.073802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.073910 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.073984 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.074566 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.074640 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.190@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
I20260807 06:43:31.084219 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.077376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:55218)
0807 06:43:31.077472 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.077511 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.077581 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.077716 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.077718 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.077946 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.078002 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.078004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.078853 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.078854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.079409 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.079410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.079864 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.079865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.079919 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.080338 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.080342 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.081640 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.083244 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.083251 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.083252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.083440 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.083649 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.083650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.083650 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.083710 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.083959 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.083965 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.084006 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.084067 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.084149 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":50,"threads_started":1}
I20260807 06:43:31.084280 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.077426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55218 (local address 127.11.137.189:36759)
0807 06:43:31.077466 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.077468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.077583 (+ 115us) server_negotiation.cc:407] Connection header received
0807 06:43:31.077635 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.077636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.077645 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.077713 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.078071 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.078779 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.079488 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.079788 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.079857 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.081737 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.081738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.081739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.081746 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.083155 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.083509 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.083510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.083510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.083582 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.083771 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.083772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.083772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.083895 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.083964 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.084113 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.084194 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:43:31.084823 21093 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.137.189:36759: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5"
member_type: NON_VOTER
last_known_addr {
host: "127.11.137.189"
port: 36759
}
attrs {
promote: true
}
}
dest_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb"
cas_config_opid_index: -1
I20260807 06:43:31.085201 21093 consensus_queue.cc:237] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } }
I20260807 06:43:31.085723 21993 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 864e0f1045e040e08daf450b3be9bbf5 (127.11.137.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.086031 21907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:31.087046 21907 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Refusing update from remote peer c421ce05bb7446dda6d5ef7ab297f1bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 06:43:31.087402 21992 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:31.088049 21993 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.137.189:36759
I20260807 06:43:31.088132 21992 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.088209 21992 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:31.089380 21907 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 864e0f1045e040e08daf450b3be9bbf5 (127.11.137.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.090411 22006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.090487 22006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.090466 21961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.090572 21842 master.cc:537] Master@127.11.137.189:36759 shutting down...
I20260807 06:43:31.090584 21961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.090842 22001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c421ce05bb7446dda6d5ef7ab297f1bb. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.090921 22001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.093526 21842 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Raft consensus shutting down.
I20260807 06:43:31.093648 21842 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Raft consensus is shut down!
I20260807 06:43:31.093698 21842 tablet_replica.cc:330] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: stopping tablet replica
I20260807 06:43:31.106475 21842 master.cc:552] Master@127.11.137.189:36759 shutdown complete.
I20260807 06:43:31.106532 21842 master_runner.cc:305] Clearing existing system tablet
I20260807 06:43:31.106663 21842 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.106730 21842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.107344 21842 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260807 06:43:31.107854 22010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.108028 21842 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.108099 21842 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.108127 21842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
uuid: "864e0f1045e040e08daf450b3be9bbf5"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "55700b1eb4fc65d87a8bd4d444c54f53"
server_key_iv: "6694e1f392cdf3d5cc95faddaeebbe57"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.108986 21842 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:31.110448 21842 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 06:43:31.110522 21842 log.cc:1196] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 06:43:31.110764 21842 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Deleting consensus metadata
I20260807 06:43:31.110888 21842 master_runner.cc:315] Copying system tablet from 127.11.137.190:34065
I20260807 06:43:31.111472 21842 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: tablet copy: Beginning tablet copy session from remote peer at address 127.11.137.190:34065
I20260807 06:43:31.117880 22020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.111784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:43128)
0807 06:43:31.111929 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.111938 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.111988 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.112129 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.112129 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.112277 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.112321 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.112322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.113312 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.113313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.113835 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.113837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.114326 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.114327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.114374 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.114867 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.114872 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.115162 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.116835 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.116836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.116837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.117005 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.117275 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.117275 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.117276 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.117347 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.117634 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.117635 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.117673 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.117728 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.117807 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260807 06:43:31.117975 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.111878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43128 (local address 127.11.137.190:34065)
0807 06:43:31.111942 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.111944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.111979 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:43:31.112051 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.112052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.112064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.112126 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.112389 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.113166 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.113916 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.114246 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.114320 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.115252 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.115254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.115254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.115261 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.116751 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.117096 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.117097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.117098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.117167 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.117418 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.117419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.117419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.117558 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.117641 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.117777 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.117859 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:43:31.118497 21133 tablet_copy_service.cc:140] P c421ce05bb7446dda6d5ef7ab297f1bb: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 864e0f1045e040e08daf450b3be9bbf5 ({username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:43128)
I20260807 06:43:31.118636 21133 tablet_copy_service.cc:161] P c421ce05bb7446dda6d5ef7ab297f1bb: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 864e0f1045e040e08daf450b3be9bbf5 at {username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:43128: session id = 864e0f1045e040e08daf450b3be9bbf5-00000000000000000000000000000000
I20260807 06:43:31.119349 21133 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:43:31.119995 21842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 06:43:31.121315 21842 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: tablet copy: Starting download of 0 data blocks...
I20260807 06:43:31.121469 21842 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: tablet copy: Starting download of 1 WAL segments...
I20260807 06:43:31.122510 21842 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:43:31.123436 21133 tablet_copy_service.cc:342] P c421ce05bb7446dda6d5ef7ab297f1bb: Request end of tablet copy session 864e0f1045e040e08daf450b3be9bbf5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:43128
I20260807 06:43:31.123507 21133 tablet_copy_service.cc:433] P c421ce05bb7446dda6d5ef7ab297f1bb: ending tablet copy session 864e0f1045e040e08daf450b3be9bbf5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 864e0f1045e040e08daf450b3be9bbf5
I20260807 06:43:31.126344 21842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:31.127538 22021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.127547 22022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.127740 22024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.129431 21842 server_base.cc:1034] running on GCE node
I20260807 06:43:31.129534 21842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:31.129714 21842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:31.130853 21842 hybrid_clock.cc:648] HybridClock initialized: now 1786085011130845 us; error 25 us; skew 500 ppm
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:31.132341 21842 init.cc:377] Logged in from keytab as oryx/127.11.137.189@KRBTEST.COM (short username oryx)
I20260807 06:43:31.132639 21842 webserver.cc:460] Webserver started at http://127.11.137.189:41561/ using document root <none> and password file <none>
I20260807 06:43:31.132777 21842 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.132823 21842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.133476 21842 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:31.134037 22032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.134200 21842 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:31.134261 21842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
uuid: "864e0f1045e040e08daf450b3be9bbf5"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "55700b1eb4fc65d87a8bd4d444c54f53"
server_key_iv: "6694e1f392cdf3d5cc95faddaeebbe57"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.134323 21842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.145308 21842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.147011 21842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.150179 21842 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.189:36759
I20260807 06:43:31.150624 21842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
I20260807 06:43:31.151499 22116 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:43:31.151758 22115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.189:36759 every 8 connection(s)
I20260807 06:43:31.152001 22116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Bootstrap starting.
I20260807 06:43:31.153846 22116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:43:31.154099 22116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Bootstrap complete.
I20260807 06:43:31.154307 22116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } }
I20260807 06:43:31.154397 22116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 864e0f1045e040e08daf450b3be9bbf5, State: Initialized, Role: LEARNER
I20260807 06:43:31.154449 22116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } }
I20260807 06:43:31.154659 22116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:31.154636 22120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } }
I20260807 06:43:31.154718 22120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.156186 22134 catalog_manager.cc:1259] Loaded cluster ID: a372f9535f8d450fb7f86c62b0fb569d
I20260807 06:43:31.156620 22134 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: loading cluster ID for follower catalog manager: success
I20260807 06:43:31.157806 22134 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: acquiring CA information for follower catalog manager: success
I20260807 06:43:31.158169 22134 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:43:31.163326 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.155713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55222 (local address 127.11.137.189:36759)
0807 06:43:31.156002 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.156005 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.156014 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:31.156037 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.156037 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.156049 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.156875 (+ 826us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.156908 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.157901 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.158955 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.159165 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.159216 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.160625 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.160626 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.160626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.160632 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.162178 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.162571 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.162572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.162572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.162627 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.162846 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.162847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.162847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.162941 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.163014 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.163191 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.163265 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for oryx/127.11.137.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.188.keytab.
Entry for principal oryx/127.11.137.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.188.keytab.
I20260807 06:43:31.192593 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:38597
--webserver_interface=127.11.137.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.188.keytab
--principal=oryx/127.11.137.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:31.292101 22137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:31.292310 22137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:31.292333 22137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:31.293586 22137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:31.293628 22137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:31.293643 22137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:31.293656 22137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:31.293706 22137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:31.295275 22137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.188.keytab
--principal=oryx/127.11.137.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:38597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.137.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:31.295534 22137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:31.295770 22137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:43:31.300755 22137 server_base.cc:1034] running on GCE node
W20260807 06:43:31.300719 22146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.300735 22153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.300740 22148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.301157 22137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:31.301476 22137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:31.302647 22137 hybrid_clock.cc:648] HybridClock initialized: now 1786085011302637 us; error 38 us; skew 500 ppm
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:31.305101 22137 init.cc:377] Logged in from keytab as oryx/127.11.137.188@KRBTEST.COM (short username oryx)
I20260807 06:43:31.305547 22137 webserver.cc:460] Webserver started at http://127.11.137.188:41591/ using document root <none> and password file <none>
I20260807 06:43:31.305747 22137 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.305787 22137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.305874 22137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:31.306912 22137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/instance:
uuid: "52acb6fea02744dc9066cfa3eb05e9af"
format_stamp: "Formatted at 2026-08-07 06:43:31 on dist-test-slave-8hhm"
server_key: "8b5bce1fe70d709cd6d1b66a46d711a2"
server_key_iv: "dd60f873f459e02deaf9634fc718e1a8"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.307225 22137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal/instance:
uuid: "52acb6fea02744dc9066cfa3eb05e9af"
format_stamp: "Formatted at 2026-08-07 06:43:31 on dist-test-slave-8hhm"
server_key: "8b5bce1fe70d709cd6d1b66a46d711a2"
server_key_iv: "dd60f873f459e02deaf9634fc718e1a8"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.308678 22137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:31.309399 22161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.309554 22137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:31.309641 22137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
uuid: "52acb6fea02744dc9066cfa3eb05e9af"
format_stamp: "Formatted at 2026-08-07 06:43:31 on dist-test-slave-8hhm"
server_key: "8b5bce1fe70d709cd6d1b66a46d711a2"
server_key_iv: "dd60f873f459e02deaf9634fc718e1a8"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.309706 22137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.334084 22137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.336125 22137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:31.336231 22137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.340394 22137 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.188:38597
I20260807 06:43:31.340492 22245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.188:38597 every 8 connection(s)
I20260807 06:43:31.340828 22137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
I20260807 06:43:31.341948 22248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:31.343439 22248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:43:31.348521 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 22137
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.188@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:31.353436 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.344405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54124 (local address 127.11.137.190:34065)
0807 06:43:31.344481 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.344483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.344495 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:31.344969 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.344971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.344985 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.345030 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.345919 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.346432 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.347501 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.347701 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.347808 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.350524 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.350526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.350526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.350534 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.351945 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.352361 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.352362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.352363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.352451 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.352773 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.352774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.352775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.352881 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.352948 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.353312 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.353376 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:43:31.353685 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.344128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54124)
0807 06:43:31.344302 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.344343 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.344851 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.345113 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.345121 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.345554 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.345824 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.345829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.346533 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.346534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.347407 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.347409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.347831 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.347833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.347994 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.348511 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.348528 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.350435 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.352049 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.352057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.352059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.352280 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.352523 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.352524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.352524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.352696 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.352963 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.352970 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.353138 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.353296 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.353467 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260807 06:43:31.354292 22248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.137.188@KRBTEST.COM
I20260807 06:43:31.357618 22253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.349135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.11.137.188:38597)
0807 06:43:31.349306 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.349311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.349338 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:43:31.349411 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.349413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.349430 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.349484 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.350247 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.351088 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.351823 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.352129 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.352209 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.354887 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.354895 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.354895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.354902 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.356373 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.356748 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.356750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.356751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.356814 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.357022 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.357023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.357023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.357161 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.357360 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.357414 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.357517 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":106,"threads_started":1}
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.188@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
I20260807 06:43:31.361444 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.354560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:46322)
0807 06:43:31.354614 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.354624 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.354664 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.354825 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.354826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.354958 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.354999 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.355000 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.355955 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.355956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.356498 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.356500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.356894 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.356895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.356963 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.357395 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.357400 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.358758 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.360375 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.360376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.360376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.360544 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.360773 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.360774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.360774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.360833 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.361108 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.361109 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.361151 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.361267 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.361360 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 06:43:31.361474 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.354663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46322 (local address 127.11.137.189:36759)
0807 06:43:31.354709 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.354711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.354718 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:31.354749 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.354750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.354758 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.354821 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.355113 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.355869 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.356606 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.356820 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.356896 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.358845 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.358846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.358847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.358854 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.360269 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.360638 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.360639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.360640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.360704 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.360905 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.360906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.360906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.361021 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.361114 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.361299 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.361381 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:31.361953 22248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.188@KRBTEST.COM for oryx/127.11.137.188@KRBTEST.COM
I20260807 06:43:31.367481 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.362194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55540)
0807 06:43:31.362243 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.362254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.362291 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.362405 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.362406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.362510 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.362536 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.362537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.363083 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.363084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.363523 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.363524 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.363841 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.363842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.363877 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.364173 (+ 296us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.364177 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.365201 (+ 1024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.366749 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.366750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.366750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.366897 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.367064 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.367065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.367065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.367113 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.367279 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.367280 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.367311 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.367360 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.367427 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 06:43:31.367633 22253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.362257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55540 (local address 127.11.137.188:38597)
0807 06:43:31.362289 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.362291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.362299 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:31.362345 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.362346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.362354 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.362395 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.362596 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.363019 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.363597 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.363777 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.363828 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.365323 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.365324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.365324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.365330 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.366680 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.366960 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.366960 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.366960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.367008 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.367150 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.367151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.367151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.367231 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.367274 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.367376 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.367471 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":15}
I20260807 06:43:31.368930 22248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Bootstrap starting.
I20260807 06:43:31.369859 22248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:31.370143 22248 log.cc:824] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:31.370865 22248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: No bootstrap required, opened a new log
I20260807 06:43:31.372321 22248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } }
I20260807 06:43:31.372442 22248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:31.372491 22248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52acb6fea02744dc9066cfa3eb05e9af, State: Initialized, Role: FOLLOWER
I20260807 06:43:31.372619 22248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } }
I20260807 06:43:31.372922 22248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:31.372887 22256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } } }
I20260807 06:43:31.372999 22256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: This master's current role is: FOLLOWER
W20260807 06:43:31.374714 22276 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:43:31.374778 22276 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:43:31.377621 22137 master_runner.cc:428] Detected that this master 52acb6fea02744dc9066cfa3eb05e9af is joining an existing cluster
I20260807 06:43:31.377691 22137 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.137.188:38597
I20260807 06:43:31.385967 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.378761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46328 (local address 127.11.137.189:36759)
0807 06:43:31.378811 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.378813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.379253 (+ 440us) server_negotiation.cc:407] Connection header received
0807 06:43:31.379326 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.379326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.379338 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.379383 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.379895 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.380580 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.381341 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.381626 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.381668 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.382795 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.382796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.382796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.382803 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.384373 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.384860 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.384861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.384861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.384932 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.385239 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.385240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.385240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.385476 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.385546 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.385773 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.385856 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:43:31.386137 22287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.378716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:46328)
0807 06:43:31.379172 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.379182 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.379265 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.379396 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.379397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.379609 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.379693 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.379695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.380654 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.380654 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.381250 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.381251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.381754 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.381755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.381815 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.382321 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.382326 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.382724 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.384468 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.384469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.384469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.384769 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.385018 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.385019 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.385020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.385088 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.385576 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.385577 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.385648 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.385724 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.385825 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":100,"threads_started":1}
I20260807 06:43:31.386579 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.379020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54134 (local address 127.11.137.190:34065)
0807 06:43:31.379062 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.379064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.379936 (+ 872us) server_negotiation.cc:407] Connection header received
0807 06:43:31.379966 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.379967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.379979 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.380049 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.380394 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.381129 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.382130 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.382431 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.382504 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.383526 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.383527 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.383527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.383535 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.385276 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.385672 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.385673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.385674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.385760 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.385968 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.385969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.385970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.386097 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.386166 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.386390 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.386462 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:31.386970 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.378980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54134)
0807 06:43:31.379641 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.379650 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.379923 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.380066 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.380068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.380249 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.380311 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.380312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.381251 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.381252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.382040 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.382042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.382518 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.382519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.382594 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.383008 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.383013 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.383423 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.385339 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.385340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.385341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.385536 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.385837 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.385837 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.385838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.385900 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.386225 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.386226 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.386277 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.386740 (+ 463us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.386857 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":143,"threads_started":1}
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085010, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.190@KRBTEST.COM for oryx/127.11.137.188@KRBTEST.COM
I20260807 06:43:31.409068 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 21201
I20260807 06:43:31.424149 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.388820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55564)
0807 06:43:31.388998 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.389010 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.389053 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.389195 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.389195 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.389381 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.389424 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.389426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.390350 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.390351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.390851 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.390852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.391335 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.391337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.391421 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.391796 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.391799 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.392958 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.423000 (+ 30042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.423002 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.423002 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.423245 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.423469 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.423470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.423470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.423528 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.423819 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.423820 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.423871 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.423917 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.424037 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260807 06:43:31.424512 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.388876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55564 (local address 127.11.137.188:38597)
0807 06:43:31.389033 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.389034 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.389041 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:31.389115 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.389115 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.389133 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.389181 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.389501 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.390267 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.390935 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.391244 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.391543 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.393046 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.393047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.393047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.393054 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.422874 (+ 29820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.423334 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.423335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.423335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.423397 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.423594 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.423595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.423595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.423743 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.424276 (+ 533us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.424329 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.424411 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260807 06:43:31.426013 21093 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.137.188:38597: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af"
member_type: NON_VOTER
last_known_addr {
host: "127.11.137.188"
port: 38597
}
attrs {
promote: true
}
}
dest_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb"
cas_config_opid_index: 5
I20260807 06:43:31.426564 21093 consensus_queue.cc:237] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } }
I20260807 06:43:31.427457 21992 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.428462 21992 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.137.188:38597
I20260807 06:43:31.428524 21992 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.428582 21992 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:31.428819 22253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.379520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55554 (local address 127.11.137.188:38597)
0807 06:43:31.379553 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.379554 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.385520 (+ 5966us) server_negotiation.cc:407] Connection header received
0807 06:43:31.385580 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.385581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.385591 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.385657 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.389327 (+ 3670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.390005 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.391007 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.391273 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.391338 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.425839 (+ 34501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.425841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.425841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.425851 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.427565 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.427964 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.427965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.427966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.428020 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.428220 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.428221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.428221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.428377 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.428431 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.428607 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.428688 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:43:31.429093 22137 master.cc:537] Master@127.11.137.188:38597 shutting down...
W20260807 06:43:31.429633 21071 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260807 06:43:31.431597 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:36981
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:34065
--webserver_port=41317
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:43:31.431821 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.379514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55554)
0807 06:43:31.385240 (+ 5726us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.385251 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.385514 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.385798 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.385799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.385967 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.389271 (+ 3304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.389273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.390093 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.390094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.390903 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.390906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.391369 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.391370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.391439 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.420812 (+ 29373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.420819 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.421289 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.427660 (+ 6371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.427661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.427661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.427883 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.428094 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.428095 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.428095 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.428155 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.428461 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.428462 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.428513 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.428931 (+ 418us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.429037 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5707,"thread_start_us":89,"threads_started":1}
W20260807 06:43:31.433837 21071 consensus_peers.cc:487] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb -> Peer 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188:38597): Couldn't send request to peer 52acb6fea02744dc9066cfa3eb05e9af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 06:43:31.434015 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.428777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:46330)
0807 06:43:31.430216 (+ 1439us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.430228 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.430280 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.430501 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.430502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.430503 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:31.430547 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.430549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.431490 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.431491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.432735 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.432738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.433732 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.433733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.433806 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.433829 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.433881 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.433923 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1423}
I20260807 06:43:31.434346 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.428876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46330 (local address 127.11.137.189:36759)
0807 06:43:31.430181 (+ 1305us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.430183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.430330 (+ 147us) server_negotiation.cc:407] Connection header received
0807 06:43:31.430358 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.430359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.430385 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.430450 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:31.430618 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.431392 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.432841 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.433527 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.433610 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.433695 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.434211 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.434262 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1270}
I20260807 06:43:31.434607 22077 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Refusing update from remote peer c421ce05bb7446dda6d5ef7ab297f1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 06:43:31.435006 22137 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:31.434994 22291 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 06:43:31.435117 22137 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:31.435169 22137 tablet_replica.cc:330] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: stopping tablet replica
I20260807 06:43:31.435444 22077 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.436918 22120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c421ce05bb7446dda6d5ef7ab297f1bb. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.437016 22120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.437055 22120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: NON_VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: true } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.437121 22120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.437983 21993 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: attempting to promote NON_VOTER 864e0f1045e040e08daf450b3be9bbf5 to VOTER
I20260807 06:43:31.438181 21993 consensus_queue.cc:237] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } }
I20260807 06:43:31.438781 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.438603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55576)
0807 06:43:31.438661 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.438734 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 06:43:31.438805 22077 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 LEARNER]: Refusing update from remote peer c421ce05bb7446dda6d5ef7ab297f1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 06:43:31.438971 21992 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 06:43:31.439328 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.439253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55580)
0807 06:43:31.439284 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.439305 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260807 06:43:31.439391 21071 consensus_peers.cc:487] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb -> Peer 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188:38597): Couldn't send request to peer 52acb6fea02744dc9066cfa3eb05e9af. Status: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 06:43:31.439721 22291 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 864e0f1045e040e08daf450b3be9bbf5 (127.11.137.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.439879 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.439743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55584)
0807 06:43:31.439808 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.439843 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 06:43:31.440580 22291 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.440702 22291 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:31.440758 22291 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.440806 22291 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:31.441097 22077 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 864e0f1045e040e08daf450b3be9bbf5 (127.11.137.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.442106 22298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.442263 22298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:43:31.448278 22137 master.cc:552] Master@127.11.137.188:38597 shutdown complete.
I20260807 06:43:31.448346 22137 master_runner.cc:305] Clearing existing system tablet
I20260807 06:43:31.448475 22137 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.448513 22137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.449420 22137 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:31.449988 22302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.450141 22137 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.450198 22137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:31.450222 22137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
uuid: "52acb6fea02744dc9066cfa3eb05e9af"
format_stamp: "Formatted at 2026-08-07 06:43:31 on dist-test-slave-8hhm"
server_key: "8b5bce1fe70d709cd6d1b66a46d711a2"
server_key_iv: "dd60f873f459e02deaf9634fc718e1a8"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.451088 22137 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:31.452381 22137 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 06:43:31.452441 22137 log.cc:1196] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 06:43:31.452627 22137 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Deleting consensus metadata
I20260807 06:43:31.452987 22137 master_runner.cc:315] Copying system tablet from 127.11.137.190:34065
I20260807 06:43:31.453621 22137 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: tablet copy: Beginning tablet copy session from remote peer at address 127.11.137.190:34065
I20260807 06:43:31.460968 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.454066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54142 (local address 127.11.137.190:34065)
0807 06:43:31.454120 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.454122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.454152 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:43:31.454175 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.454176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.454187 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.454240 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.454588 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.455364 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.456406 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.456684 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.456752 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.457903 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.457904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.457904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.457912 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.459640 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.460063 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.460063 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.460064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.460135 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.460408 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.460409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.460409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.460541 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.460610 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.460802 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.460879 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 06:43:31.460973 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.453911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54142)
0807 06:43:31.454042 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.454055 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.454116 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.454245 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.454246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.454445 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.454500 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.454502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.455463 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.455464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.456299 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.456302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.456768 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.456769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.456827 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.457369 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.457375 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.457800 (+ 425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.459739 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.459740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.459741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.459978 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.460252 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.460253 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.460253 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.460331 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.460622 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.460623 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.460674 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.460765 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.460874 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260807 06:43:31.461570 21133 tablet_copy_service.cc:140] P c421ce05bb7446dda6d5ef7ab297f1bb: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 52acb6fea02744dc9066cfa3eb05e9af ({username='oryx', principal='oryx/127.11.137.188@KRBTEST.COM'} at 127.0.0.1:54142)
I20260807 06:43:31.461629 21133 tablet_copy_service.cc:161] P c421ce05bb7446dda6d5ef7ab297f1bb: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 52acb6fea02744dc9066cfa3eb05e9af at {username='oryx', principal='oryx/127.11.137.188@KRBTEST.COM'} at 127.0.0.1:54142: session id = 52acb6fea02744dc9066cfa3eb05e9af-00000000000000000000000000000000
I20260807 06:43:31.462214 21133 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:43:31.462739 22137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 06:43:31.464092 22137 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: tablet copy: Starting download of 0 data blocks...
I20260807 06:43:31.464229 22137 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: tablet copy: Starting download of 1 WAL segments...
I20260807 06:43:31.465085 22137 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:43:31.466110 21133 tablet_copy_service.cc:342] P c421ce05bb7446dda6d5ef7ab297f1bb: Request end of tablet copy session 52acb6fea02744dc9066cfa3eb05e9af-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.137.188@KRBTEST.COM'} at 127.0.0.1:54142
I20260807 06:43:31.466176 21133 tablet_copy_service.cc:433] P c421ce05bb7446dda6d5ef7ab297f1bb: ending tablet copy session 52acb6fea02744dc9066cfa3eb05e9af-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 52acb6fea02744dc9066cfa3eb05e9af
I20260807 06:43:31.468662 22137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:31.469825 22318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.470058 22137 server_base.cc:1034] running on GCE node
W20260807 06:43:31.470155 22315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.477959 22316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.478209 22137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:31.478405 22137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:31.479564 22137 hybrid_clock.cc:648] HybridClock initialized: now 1786085011479539 us; error 40 us; skew 500 ppm
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:31.481283 22137 init.cc:377] Logged in from keytab as oryx/127.11.137.188@KRBTEST.COM (short username oryx)
I20260807 06:43:31.481578 22137 webserver.cc:460] Webserver started at http://127.11.137.188:45167/ using document root <none> and password file <none>
I20260807 06:43:31.481731 22137 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.481774 22137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.482592 22137 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:31.483206 22327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.483319 22137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:31.483358 22137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
uuid: "52acb6fea02744dc9066cfa3eb05e9af"
format_stamp: "Formatted at 2026-08-07 06:43:31 on dist-test-slave-8hhm"
server_key: "8b5bce1fe70d709cd6d1b66a46d711a2"
server_key_iv: "dd60f873f459e02deaf9634fc718e1a8"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.483419 22137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.496824 22137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.498723 22137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.501857 22137 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.188:38597
I20260807 06:43:31.502239 22137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
I20260807 06:43:31.505350 22408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.188:38597 every 8 connection(s)
I20260807 06:43:31.506062 22410 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:43:31.506583 22410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Bootstrap starting.
I20260807 06:43:31.509733 22410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:43:31.509948 22410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: Bootstrap complete.
I20260807 06:43:31.510140 22410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } }
I20260807 06:43:31.510237 22410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 52acb6fea02744dc9066cfa3eb05e9af, State: Initialized, Role: LEARNER
I20260807 06:43:31.510274 22410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } }
I20260807 06:43:31.510497 22410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:31.510473 22413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:31.510726 22413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:31.512037 22432 catalog_manager.cc:1259] Loaded cluster ID: a372f9535f8d450fb7f86c62b0fb569d
I20260807 06:43:31.512131 22432 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: loading cluster ID for follower catalog manager: success
I20260807 06:43:31.513453 22432 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: acquiring CA information for follower catalog manager: success
I20260807 06:43:31.513800 22432 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 06:43:31.532440 22294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:31.532624 22294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:31.532645 22294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:31.533988 22294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:31.534026 22294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:31.534051 22294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:31.535636 22294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:36981
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=41317
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:31.535866 22294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:31.536134 22294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:31.541173 22443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.541177 22445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.541374 22294 server_base.cc:1034] running on GCE node
W20260807 06:43:31.541531 22448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.541738 22294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:31.542001 22294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:31.543169 22294 hybrid_clock.cc:648] HybridClock initialized: now 1786085011543151 us; error 48 us; skew 500 ppm
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:31.545746 22294 init.cc:377] Logged in from keytab as oryx/127.11.137.129@KRBTEST.COM (short username oryx)
I20260807 06:43:31.546218 22294 webserver.cc:460] Webserver started at http://127.11.137.129:41317/ using document root <none> and password file <none>
I20260807 06:43:31.546468 22294 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.546522 22294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.547856 22294 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:31.548470 22455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.548673 22294 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.548779 22294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "7be4cfd90afd47558e892c1e39bfb46f"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "51b83933ff763127aad8f55d8eba9951"
server_key_iv: "dd2778ad2fd84819e55cc117622b0457"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.549127 22294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.562688 22294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.564947 22294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:31.565112 22294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.565390 22294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:31.565703 22294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:31.565754 22294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.565788 22294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:31.565814 22294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.571966 22294 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:36981
I20260807 06:43:31.572018 22621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:36981 every 8 connection(s)
I20260807 06:43:31.572376 22294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:31.579052 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 22294
I20260807 06:43:31.579236 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 21411
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.188@KRBTEST.COM
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:31.587594 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.573387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:34707 (local address 127.11.137.190:34065)
0807 06:43:31.573538 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.573540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.573549 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:31.574849 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.574851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.574866 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.574899 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.575873 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.576368 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.577769 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.578066 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.578140 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.583938 (+ 5798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.583940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.583940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.583948 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.585874 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.586445 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.586446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.586447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.586510 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.586805 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.586806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.586807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.586948 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.587005 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.587395 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.587485 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260807 06:43:31.588091 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.573071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.11.137.129:34997)
0807 06:43:31.573260 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.573304 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.574718 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.574987 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.574991 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.575505 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.575756 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.575762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.576945 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.576946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.577609 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.577612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.578091 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.578093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.578237 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.579038 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.579044 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.583819 (+ 4775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.586725 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.586726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.586727 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.586979 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.587182 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.587182 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.587183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.587236 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.587524 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.587525 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.587563 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.587660 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.587859 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":31,"thread_start_us":87,"threads_started":1}
I20260807 06:43:31.588415 22633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.573072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:34707)
0807 06:43:31.573333 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.573344 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.574718 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.574984 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.574988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.575495 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.575755 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.575761 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.576482 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.576484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.577645 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.577649 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.578187 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.578188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.578247 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.578774 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.578784 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.583819 (+ 5035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.585972 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.585980 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.585982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.586349 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.586583 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.586583 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.586584 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.586725 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.587040 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.587047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.587226 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.587972 (+ 746us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.588058 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":3,"thread_start_us":122,"threads_started":1}
I20260807 06:43:31.588464 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.573078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:34997 (local address 127.11.137.188:38597)
0807 06:43:31.573251 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.573253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.573474 (+ 221us) server_negotiation.cc:407] Connection header received
0807 06:43:31.574884 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.574886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.574899 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.574968 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.575872 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.576858 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.577707 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.577996 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.578058 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.583930 (+ 5872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.583932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.583932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.583939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.586549 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.587060 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.587061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.587061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.587117 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.587302 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.587303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.587303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.587441 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.587498 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.588275 (+ 777us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.588362 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
I20260807 06:43:31.589197 22624 heartbeater.cc:347] Connected to a master server at 127.11.137.190:34065
I20260807 06:43:31.589340 22624 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.589527 22624 heartbeater.cc:511] Master 127.11.137.190:34065 requested a full tablet report, sending...
I20260807 06:43:31.589922 21093 ts_manager.cc:194] Re-registered known tserver with Master: 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:31.590624 21093 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:34707
I20260807 06:43:31.594231 22635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.573508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.11.137.129:41965)
0807 06:43:31.573629 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.573640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.574730 (+ 1090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.574985 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.574989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.575510 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.575756 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.575762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.576713 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.576714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.577649 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.577650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.578129 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.578130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.578237 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.579178 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.579182 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.589543 (+ 10361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.592716 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.592717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.592718 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.592925 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.593168 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.593169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.593169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.593246 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.593690 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.593691 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.593731 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.593787 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.593905 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":26,"thread_start_us":72,"threads_started":1}
I20260807 06:43:31.594220 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.573595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:41965 (local address 127.11.137.189:36759)
0807 06:43:31.573641 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.573643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.573690 (+ 47us) server_negotiation.cc:407] Connection header received
0807 06:43:31.574827 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.574828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.574841 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.574901 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.575873 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.576628 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.577791 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.577982 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.578080 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.589654 (+ 11574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.589655 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.589656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.589665 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.592615 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.593009 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.593010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.593011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.593090 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.593375 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.593377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.593377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.593595 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.593709 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.593875 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.594053 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 06:43:31.594692 22627 heartbeater.cc:347] Connected to a master server at 127.11.137.189:36759
I20260807 06:43:31.594759 22627 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.594870 22627 heartbeater.cc:511] Master 127.11.137.189:36759 requested a full tablet report, sending...
I20260807 06:43:31.595305 22061 ts_manager.cc:194] Registered new tserver with Master: 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:31.598937 22623 heartbeater.cc:347] Connected to a master server at 127.11.137.188:38597
I20260807 06:43:31.599018 22623 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.599080 22623 heartbeater.cc:511] Master 127.11.137.188:38597 requested a full tablet report, sending...
I20260807 06:43:31.599438 22353 ts_manager.cc:194] Registered new tserver with Master: 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:31.602993 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:35711
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:34065
--webserver_port=38049
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:31.686786 22638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:31.687022 22638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:31.687057 22638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:31.688199 22638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:31.688268 22638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:31.688313 22638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:31.689854 22638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:35711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=38049
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:31.690117 22638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:31.690344 22638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:31.695384 22650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.695446 22638 server_base.cc:1034] running on GCE node
W20260807 06:43:31.695462 22647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.695462 22653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.695763 22638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:31.695956 22638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:31.697129 22638 hybrid_clock.cc:648] HybridClock initialized: now 1786085011697110 us; error 45 us; skew 500 ppm
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:31.699723 22638 init.cc:377] Logged in from keytab as oryx/127.11.137.130@KRBTEST.COM (short username oryx)
I20260807 06:43:31.700079 22638 webserver.cc:460] Webserver started at http://127.11.137.130:38049/ using document root <none> and password file <none>
I20260807 06:43:31.700268 22638 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.700317 22638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.701619 22638 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:31.702169 22662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.702344 22638 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:31.702428 22638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "fc66669b33f64094b9106b8703a7a959"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "9124b89f2b6827636c8d175f08441bed"
server_key_iv: "aa328cfbbdc1032f3d5b9d863844924b"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.702726 22638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.710537 22638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.712601 22638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:31.712762 22638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.712970 22638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:31.713323 22638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:31.713376 22638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.713416 22638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:31.713444 22638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.719273 22638 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:35711
I20260807 06:43:31.719311 22843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:35711 every 8 connection(s)
I20260807 06:43:31.719668 22638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.188@KRBTEST.COM
I20260807 06:43:31.728138 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 22638
I20260807 06:43:31.728323 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 21628
I20260807 06:43:31.730420 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.720527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:44963 (local address 127.11.137.189:36759)
0807 06:43:31.720575 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.720577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.720947 (+ 370us) server_negotiation.cc:407] Connection header received
0807 06:43:31.721877 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.721879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.721892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.721927 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.722659 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.723409 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724557 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.724750 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724830 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.727334 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.727336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.727336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.727345 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.728959 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.729435 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.729436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.729436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.729500 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.729751 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.729752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.729752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.729878 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.729922 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.730213 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.730292 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:43:31.730937 22851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.720375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.11.137.130:44963)
0807 06:43:31.720870 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.720880 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.721755 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.722013 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.722013 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.722431 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.722549 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.722556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.723515 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.723516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.724447 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.724449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.724829 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.724895 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.725360 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.725364 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.727211 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.729051 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.729059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.729061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.729357 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.729565 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.729565 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.729566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.729690 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.729948 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.729952 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.730087 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.730492 (+ 405us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.730650 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":280,"thread_start_us":95,"threads_started":1}
I20260807 06:43:31.740329 22846 heartbeater.cc:347] Connected to a master server at 127.11.137.189:36759
I20260807 06:43:31.740463 22846 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.740696 22846 heartbeater.cc:511] Master 127.11.137.189:36759 requested a full tablet report, sending...
I20260807 06:43:31.741431 22061 ts_manager.cc:194] Registered new tserver with Master: fc66669b33f64094b9106b8703a7a959 (127.11.137.130:35711)
I20260807 06:43:31.743211 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.720414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:55745 (local address 127.11.137.190:34065)
0807 06:43:31.720619 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.720622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.720788 (+ 166us) server_negotiation.cc:407] Connection header received
0807 06:43:31.721857 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.721858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.721872 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.721935 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.722645 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.723131 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724140 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.724346 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724426 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.726861 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.726862 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.726862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.726869 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.741929 (+ 15060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.742360 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.742362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.742362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.742428 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.742634 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.742635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.742636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.742784 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.742851 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.743045 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.743118 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260807 06:43:31.743224 22852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.720374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:55745)
0807 06:43:31.720709 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.720738 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.721759 (+ 1021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.722005 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.722010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.722355 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.722549 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.722553 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.723239 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.723240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.724047 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.724049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.724433 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.724574 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.725122 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.725131 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.726772 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.742029 (+ 15257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.742031 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.742031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.742256 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.742498 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.742499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.742499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.742564 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.742879 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.742880 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.742923 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.743006 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.743114 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":20,"thread_start_us":86,"threads_started":1}
I20260807 06:43:31.743883 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.720468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:51745 (local address 127.11.137.188:38597)
0807 06:43:31.720518 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.720520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.720746 (+ 226us) server_negotiation.cc:407] Connection header received
0807 06:43:31.721877 (+ 1131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.721879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.721896 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.721927 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.722659 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.723424 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724534 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.724855 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724941 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.727955 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.727957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.727957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.727966 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.742414 (+ 14448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.742903 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.742905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.742905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.742973 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.743227 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.743228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.743228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.743367 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.743410 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.743649 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.743768 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:31.743935 22850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.720374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.11.137.130:51745)
0807 06:43:31.720596 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.720645 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.721745 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.722007 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.722011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.722428 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.722549 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.722556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.723515 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.723516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.724447 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.724449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.724940 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.724941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.725001 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.725530 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.725535 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.727846 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.742638 (+ 14792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.742639 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.742639 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.742826 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.743080 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.743081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.743082 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.743147 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.743476 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.743477 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.743519 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.743587 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.743700 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":37,"thread_start_us":94,"threads_started":1}
I20260807 06:43:31.744100 22845 heartbeater.cc:347] Connected to a master server at 127.11.137.190:34065
I20260807 06:43:31.744144 22845 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.744227 22845 heartbeater.cc:511] Master 127.11.137.190:34065 requested a full tablet report, sending...
I20260807 06:43:31.744309 22844 heartbeater.cc:347] Connected to a master server at 127.11.137.188:38597
I20260807 06:43:31.744346 22844 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.744410 22844 heartbeater.cc:511] Master 127.11.137.188:38597 requested a full tablet report, sending...
I20260807 06:43:31.744570 21093 ts_manager.cc:194] Re-registered known tserver with Master: fc66669b33f64094b9106b8703a7a959 (127.11.137.130:35711)
I20260807 06:43:31.744669 22353 ts_manager.cc:194] Registered new tserver with Master: fc66669b33f64094b9106b8703a7a959 (127.11.137.130:35711)
I20260807 06:43:31.744987 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:40247
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:34065
--webserver_port=40633
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:43:31.745026 21093 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:55745
W20260807 06:43:31.828941 22853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:31.829154 22853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:31.829177 22853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:31.830425 22853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:31.830467 22853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:31.830521 22853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:31.831984 22853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:40247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=40633
--tserver_master_addrs=127.11.137.190:34065,127.11.137.189:36759,127.11.137.188:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:31.832233 22853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:31.832470 22853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:31.837730 22861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.837864 22864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:31.837735 22862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:31.838721 22853 server_base.cc:1034] running on GCE node
I20260807 06:43:31.838910 22853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:31.839149 22853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:31.840312 22853 hybrid_clock.cc:648] HybridClock initialized: now 1786085011840295 us; error 49 us; skew 500 ppm
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:31.842790 22853 init.cc:377] Logged in from keytab as oryx/127.11.137.131@KRBTEST.COM (short username oryx)
I20260807 06:43:31.843218 22853 webserver.cc:460] Webserver started at http://127.11.137.131:40633/ using document root <none> and password file <none>
I20260807 06:43:31.843392 22853 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:31.843441 22853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:31.844693 22853 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:31.845314 22874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.845513 22853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:43:31.845585 22853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "ea9543ab11c84129891983da282c6496"
format_stamp: "Formatted at 2026-08-07 06:43:30 on dist-test-slave-8hhm"
server_key: "c8c892b73456f386078258e2d85aeb4a"
server_key_iv: "4dd36f5be72399fffe29929a799a730a"
server_key_version: "encryptionkey@0"
I20260807 06:43:31.845942 22853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:31.866205 22853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:31.868592 22853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:31.868747 22853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:31.869012 22853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:31.869378 22853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:31.869413 22853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.869437 22853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:31.869482 22853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:31.875375 22853 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:40247
I20260807 06:43:31.875463 23064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:40247 every 8 connection(s)
I20260807 06:43:31.875793 22853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:31.880716 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 22853
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.189@KRBTEST.COM
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.188@KRBTEST.COM
Aug 07 06:43:31 dist-test-slave-8hhm krb5kdc[21020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085011, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:31.889175 23075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.876516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.11.137.131:53025)
0807 06:43:31.876856 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.876893 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.877929 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.878229 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.878229 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.878594 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.878795 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.878802 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.879767 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.879768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.880814 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.880816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.882352 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.882353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.882417 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.882833 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.882841 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.884650 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.887433 (+ 2783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.887440 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.887442 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.887752 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.887990 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.887991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.887991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.888137 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.888452 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.888459 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.888633 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.888742 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.888920 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":40,"thread_start_us":113,"threads_started":1}
I20260807 06:43:31.889238 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.876664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:37085 (local address 127.11.137.189:36759)
0807 06:43:31.876779 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.876782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.877072 (+ 290us) server_negotiation.cc:407] Connection header received
0807 06:43:31.878074 (+ 1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.878076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.878090 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.878145 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.878916 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.879416 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.880955 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.881276 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.881329 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.885510 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.885512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.885512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.885520 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.887753 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888132 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.888134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.888134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.888190 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888396 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.888396 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.888397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.888534 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.888577 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.889036 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.889113 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:43:31.889536 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.876782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:48461 (local address 127.11.137.190:34065)
0807 06:43:31.876851 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.876853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.877362 (+ 509us) server_negotiation.cc:407] Connection header received
0807 06:43:31.878118 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.878119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.878131 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.878159 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.878912 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.879687 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.882506 (+ 2819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.882846 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.882958 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.885563 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.885564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.885565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.885572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.888193 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888616 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.888618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.888618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.888680 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888899 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.888900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.888900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.889014 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.889087 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.889314 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.889401 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:43:31.889665 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.876612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:53025 (local address 127.11.137.188:38597)
0807 06:43:31.876776 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.876778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.877002 (+ 224us) server_negotiation.cc:407] Connection header received
0807 06:43:31.878144 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.878145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.878158 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.878206 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.878913 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.879694 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.881845 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.882216 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.882292 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.884753 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.884755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.884755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.884763 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.887345 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.887845 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.887847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.887847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.887905 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888212 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.888213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.888213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.888344 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.888424 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.889466 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.889558 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260807 06:43:31.889910 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.876522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:48461)
0807 06:43:31.877288 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.877302 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.877941 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.878229 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.878230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.878594 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.878796 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.878802 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.880904 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.880906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.881705 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.881707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.882962 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.882963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.883050 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.883512 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.883517 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.885115 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.888304 (+ 3189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.888306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.888531 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.888754 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.888755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.888810 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.889092 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.889093 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.889141 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.889664 (+ 523us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.889790 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"mutex_wait_us":24,"thread_start_us":110,"threads_started":1}
I20260807 06:43:31.890043 23065 heartbeater.cc:347] Connected to a master server at 127.11.137.188:38597
I20260807 06:43:31.890142 23065 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.890224 23067 heartbeater.cc:347] Connected to a master server at 127.11.137.190:34065
I20260807 06:43:31.890278 23067 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.890336 23065 heartbeater.cc:511] Master 127.11.137.188:38597 requested a full tablet report, sending...
I20260807 06:43:31.890358 23067 heartbeater.cc:511] Master 127.11.137.190:34065 requested a full tablet report, sending...
I20260807 06:43:31.890727 21093 ts_manager.cc:194] Re-registered known tserver with Master: ea9543ab11c84129891983da282c6496 (127.11.137.131:40247)
I20260807 06:43:31.890770 22353 ts_manager.cc:194] Registered new tserver with Master: ea9543ab11c84129891983da282c6496 (127.11.137.131:40247)
I20260807 06:43:31.891224 21093 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:48461
I20260807 06:43:31.892733 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.882298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55586 (local address 127.11.137.188:38597)
0807 06:43:31.882398 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.882400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.883379 (+ 979us) server_negotiation.cc:407] Connection header received
0807 06:43:31.883497 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.883497 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.883509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.883575 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.884443 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.885285 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.886585 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.886905 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.886948 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.888458 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.888459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.888460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.888469 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.891053 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.891575 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.891576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.891577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.891639 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.892106 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.892107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.892107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.892273 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.892367 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.892550 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.892641 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":58,"threads_started":1}
I20260807 06:43:31.892910 23074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.876517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.11.137.131:37085)
0807 06:43:31.876992 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.877002 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.877929 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.878216 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.878220 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.878594 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:31.878795 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.878800 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.879531 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.879532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.880864 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.880866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.881414 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.881415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.881547 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.882091 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:31.882100 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:31.885444 (+ 3344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:31.887844 (+ 2400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.887845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.887845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.888049 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.888268 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:31.888268 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:31.888268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:31.888321 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:31.888625 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:31.888626 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:31.888657 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.892684 (+ 4027us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.892804 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":5,"spinlock_wait_cycles":6528,"thread_start_us":104,"threads_started":1}
I20260807 06:43:31.893817 23068 heartbeater.cc:347] Connected to a master server at 127.11.137.189:36759
I20260807 06:43:31.893893 23068 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:31.893968 23068 heartbeater.cc:511] Master 127.11.137.189:36759 requested a full tablet report, sending...
I20260807 06:43:31.894230 22061 ts_manager.cc:194] Registered new tserver with Master: ea9543ab11c84129891983da282c6496 (127.11.137.131:40247)
I20260807 06:43:31.896148 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.882057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54158 (local address 127.11.137.190:34065)
0807 06:43:31.883789 (+ 1732us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.883791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.883907 (+ 116us) server_negotiation.cc:407] Connection header received
0807 06:43:31.884020 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.884021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.884033 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.884078 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.885392 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.886549 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.891300 (+ 4751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.891607 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.891646 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.893239 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.893240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.893240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.893248 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.894946 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.895327 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.895328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.895328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.895387 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.895611 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.895612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.895613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.895722 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.895832 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.895929 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.896024 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1704,"thread_start_us":90,"threads_started":1}
I20260807 06:43:31.897181 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.882531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46346 (local address 127.11.137.189:36759)
0807 06:43:31.889317 (+ 6786us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.889319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.889326 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:31.889346 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.889347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.889357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.889411 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:31.890332 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.890958 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.892294 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.892583 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.892649 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.894453 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:31.894454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:31.894454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:31.894460 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:31.895813 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.896337 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.896338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.896338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.896401 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:31.896607 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:31.896608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:31.896608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:31.896777 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:31.896871 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.896999 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.897073 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6768,"thread_start_us":309,"threads_started":1}
I20260807 06:43:31.897804 21093 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:31.899411 21093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:31.906423 23105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.902786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36981 (local address 127.0.0.1:53426)
0807 06:43:31.903107 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.903117 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.903214 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.903556 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.903557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.903560 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:31.903603 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.903604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.904430 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.904431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.905437 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.905440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.906189 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.906190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.906249 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.906252 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.906314 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.906353 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":94,"threads_started":1}
I20260807 06:43:31.906591 23106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.902894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53426 (local address 127.11.137.129:36981)
0807 06:43:31.903363 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.903367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.903374 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:31.903405 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.903406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.903417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.903557 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:31.903670 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.904339 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.905526 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.906102 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.906199 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.906258 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.906329 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.906402 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":85,"threads_started":1}
I20260807 06:43:31.907035 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.902668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40247 (local address 127.0.0.1:52386)
0807 06:43:31.902724 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.902735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.902773 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.903433 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.903434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.903436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:31.903482 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.903484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.904788 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.904789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.905921 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.905923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.906850 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.906851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.906911 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.906914 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.906939 (+ 25us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.906975 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 06:43:31.907220 22524 tablet_service.cc:1467] Processing CreateTablet for tablet 6d77f5aa34d948019c3840f72b3c6a79 (DEFAULT_TABLE table=test-table [id=ed26535b2ac04aabb8d915f16d8b2d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:31.907349 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.903105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52386 (local address 127.11.137.131:40247)
0807 06:43:31.903270 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.903274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.903284 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:31.903323 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.903325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.903338 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.903435 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:31.903567 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.904689 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.906049 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.906747 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.907164 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.907219 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.907244 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.907277 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":79,"threads_started":1}
I20260807 06:43:31.907618 22524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d77f5aa34d948019c3840f72b3c6a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:31.907655 23104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.902784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:35711 (local address 127.0.0.1:52770)
0807 06:43:31.902926 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.902936 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.902980 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.903987 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.903988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.903990 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:31.904044 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.904046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.905360 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.905361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.906486 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.906489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.907480 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.907481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.907551 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.907553 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.907586 (+ 33us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.907612 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":112,"threads_started":1}
I20260807 06:43:31.907934 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.903098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52770 (local address 127.11.137.130:35711)
0807 06:43:31.903557 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.903561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.903571 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:31.903611 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.903613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.903640 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.903876 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:31.904121 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.905270 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.906579 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.907326 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.907411 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.907803 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.907837 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.907877 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":89,"threads_started":1}
I20260807 06:43:31.908489 22739 tablet_service.cc:1467] Processing CreateTablet for tablet 6d77f5aa34d948019c3840f72b3c6a79 (DEFAULT_TABLE table=test-table [id=ed26535b2ac04aabb8d915f16d8b2d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:31.908787 22739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d77f5aa34d948019c3840f72b3c6a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:31.910854 23110 tablet_bootstrap.cc:492] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Bootstrap starting.
I20260807 06:43:31.911623 23110 tablet_bootstrap.cc:654] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:31.911912 23112 tablet_bootstrap.cc:492] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Bootstrap starting.
I20260807 06:43:31.912012 23110 log.cc:824] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:31.912392 22949 tablet_service.cc:1467] Processing CreateTablet for tablet 6d77f5aa34d948019c3840f72b3c6a79 (DEFAULT_TABLE table=test-table [id=ed26535b2ac04aabb8d915f16d8b2d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:31.912710 23112 tablet_bootstrap.cc:654] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:31.912770 22949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d77f5aa34d948019c3840f72b3c6a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:31.913015 23112 log.cc:824] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:31.913293 23110 tablet_bootstrap.cc:492] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: No bootstrap required, opened a new log
I20260807 06:43:31.913365 23110 ts_tablet_manager.cc:1397] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:43:31.914176 23112 tablet_bootstrap.cc:492] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: No bootstrap required, opened a new log
I20260807 06:43:31.914292 23112 ts_tablet_manager.cc:1397] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:43:31.915922 23116 tablet_bootstrap.cc:492] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Bootstrap starting.
I20260807 06:43:31.916096 23110 raft_consensus.cc:348] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.916314 23110 raft_consensus.cc:374] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:31.916350 23110 raft_consensus.cc:729] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be4cfd90afd47558e892c1e39bfb46f, State: Initialized, Role: FOLLOWER
I20260807 06:43:31.916487 23110 consensus_queue.cc:260] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.916543 23116 tablet_bootstrap.cc:654] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:31.916743 23110 ts_tablet_manager.cc:1428] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:31.916853 23116 log.cc:824] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:31.916863 23112 raft_consensus.cc:348] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.917248 22624 heartbeater.cc:503] Master 127.11.137.190:34065 was elected leader, sending a full tablet report...
I20260807 06:43:31.917105 23112 raft_consensus.cc:374] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:31.917397 23112 raft_consensus.cc:729] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc66669b33f64094b9106b8703a7a959, State: Initialized, Role: FOLLOWER
I20260807 06:43:31.917548 23112 consensus_queue.cc:260] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.917829 23112 ts_tablet_manager.cc:1428] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 06:43:31.917969 22845 heartbeater.cc:503] Master 127.11.137.190:34065 was elected leader, sending a full tablet report...
I20260807 06:43:31.918905 23116 tablet_bootstrap.cc:492] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: No bootstrap required, opened a new log
I20260807 06:43:31.919034 23116 ts_tablet_manager.cc:1397] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:43:31.920841 23116 raft_consensus.cc:348] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.921002 23116 raft_consensus.cc:374] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:31.921058 23116 raft_consensus.cc:729] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9543ab11c84129891983da282c6496, State: Initialized, Role: FOLLOWER
I20260807 06:43:31.921175 23116 consensus_queue.cc:260] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.921630 23116 ts_tablet_manager.cc:1428] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:43:31.921630 23067 heartbeater.cc:503] Master 127.11.137.190:34065 was elected leader, sending a full tablet report...
I20260807 06:43:31.970136 23124 raft_consensus.cc:482] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:31.970263 23124 raft_consensus.cc:504] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.970733 23124 leader_election.cc:288] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea9543ab11c84129891983da282c6496 (127.11.137.131:40247), 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
W20260807 06:43:31.971014 22849 tablet.cc:2369] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:31.973724 22852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.971055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36981 (local address 127.11.137.130:55637)
0807 06:43:31.971147 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.971158 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.971214 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.971411 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.971412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.971413 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:31.971483 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.971484 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.972124 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.972125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.972853 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.972854 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.973449 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.973450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.973534 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.973537 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.973605 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.973647 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 06:43:31.973724 23106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.971239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:55637 (local address 127.11.137.129:36981)
0807 06:43:31.971287 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.971289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.971296 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:31.971329 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.971330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.971336 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.971406 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:31.971556 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.972035 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.972950 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.973365 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.973450 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.973458 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.973613 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.973648 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:43:31.973750 22850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.970945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40247 (local address 127.11.137.130:52665)
0807 06:43:31.971021 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:31.971036 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:31.971114 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:31.971319 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:31.971320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:31.971321 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:31.971380 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.971381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.972069 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.972070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.972835 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:31.972838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.973445 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.973447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:31.973528 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.973531 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:31.973612 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:43:31.973653 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 06:43:31.973733 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.970999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:52665 (local address 127.11.137.131:40247)
0807 06:43:31.971048 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.971050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.971169 (+ 119us) server_negotiation.cc:407] Connection header received
0807 06:43:31.971201 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.971202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.971212 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.971262 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:31.971457 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.971958 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.972934 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:31.973356 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:31.973447 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:31.973455 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:31.973625 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 06:43:31.973664 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:43:31.974108 22553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d77f5aa34d948019c3840f72b3c6a79" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be4cfd90afd47558e892c1e39bfb46f" is_pre_election: true
I20260807 06:43:31.974231 22553 raft_consensus.cc:2454] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 0.
I20260807 06:43:31.974215 22988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d77f5aa34d948019c3840f72b3c6a79" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9543ab11c84129891983da282c6496" is_pre_election: true
I20260807 06:43:31.974334 22988 raft_consensus.cc:2454] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 0.
I20260807 06:43:31.974466 22666 leader_election.cc:302] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be4cfd90afd47558e892c1e39bfb46f, fc66669b33f64094b9106b8703a7a959; no voters:
I20260807 06:43:31.974633 23124 raft_consensus.cc:2781] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:31.974704 23124 raft_consensus.cc:482] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:31.974721 23124 raft_consensus.cc:3037] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:31.975458 23124 raft_consensus.cc:504] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.975605 23124 leader_election.cc:288] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 election: Requested vote from peers ea9543ab11c84129891983da282c6496 (127.11.137.131:40247), 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:31.975837 22553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d77f5aa34d948019c3840f72b3c6a79" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be4cfd90afd47558e892c1e39bfb46f"
I20260807 06:43:31.975831 22988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d77f5aa34d948019c3840f72b3c6a79" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9543ab11c84129891983da282c6496"
I20260807 06:43:31.975910 22553 raft_consensus.cc:3037] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:31.975931 22988 raft_consensus.cc:3037] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:31.976613 22553 raft_consensus.cc:2454] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 1.
I20260807 06:43:31.976709 22988 raft_consensus.cc:2454] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 1.
I20260807 06:43:31.976791 22666 leader_election.cc:302] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be4cfd90afd47558e892c1e39bfb46f, fc66669b33f64094b9106b8703a7a959; no voters:
I20260807 06:43:31.976925 23124 raft_consensus.cc:2781] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:31.977145 23124 raft_consensus.cc:686] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 1 LEADER]: Becoming Leader. State: Replica: fc66669b33f64094b9106b8703a7a959, State: Running, Role: LEADER
I20260807 06:43:31.977291 23124 consensus_queue.cc:237] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } }
I20260807 06:43:31.978132 21093 catalog_manager.cc:5495] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc66669b33f64094b9106b8703a7a959 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "fc66669b33f64094b9106b8703a7a959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:32.001562 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:31.999196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.11.137.130:35711)
0807 06:43:31.999243 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:31.999245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:31.999255 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:31.999315 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:31.999315 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:31.999334 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:31.999421 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:31.999542 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.000012 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.000774 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.000991 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.001068 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:32.001239 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:32.001341 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:32.001437 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:32.001457 (+ 20us) server_negotiation.cc:299] Negotiation successful
0807 06:43:32.001479 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:43:32.003374 22553 raft_consensus.cc:1261] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Refusing update from remote peer fc66669b33f64094b9106b8703a7a959: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:32.003394 22988 raft_consensus.cc:1261] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Refusing update from remote peer fc66669b33f64094b9106b8703a7a959: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:32.003804 23127 consensus_queue.cc:1035] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:32.003944 23124 consensus_queue.cc:1035] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:32.007184 23137 mvcc.cc:205] Tried to move back new op lower bound from 7315804209163014144 to 7315804209059475456. Current Snapshot: MvccSnapshot[applied={T|T < 7315804209163014144}]
I20260807 06:43:32.009405 23136 mvcc.cc:205] Tried to move back new op lower bound from 7315804209163014144 to 7315804209059475456. Current Snapshot: MvccSnapshot[applied={T|T < 7315804209163014144}]
I20260807 06:43:32.011257 23104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:32.007552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55596)
0807 06:43:32.007597 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:32.007609 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:32.007649 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:32.007839 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:32.007840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:32.007842 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:32.007886 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:32.007888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.008921 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.008922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:32.010050 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:32.010053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.010994 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.010995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:32.011060 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:32.011063 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:32.011109 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 06:43:32.011178 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 06:43:32.011543 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:32.007612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55596 (local address 127.11.137.188:38597)
0807 06:43:32.007650 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:32.007652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:32.007661 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:32.007708 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:32.007708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:32.007732 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:32.007791 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:32.007943 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.008693 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.010141 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.010783 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.010874 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:32.010951 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:32.011425 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 06:43:32.011477 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:32.011894 22375 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.10] Dedup: 1.7->[1.8-1.10]
I20260807 06:43:32.012151 21093 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:32.012241 21093 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:32.012835 23151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: SysCatalogTable state changed. Reason: New leader c421ce05bb7446dda6d5ef7ab297f1bb. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:32.012944 23151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: This master's current role is: LEARNER
I20260807 06:43:32.013996 21993 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: NON_VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: true } } }
I20260807 06:43:32.014129 21993 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:32.014278 21093 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: Sending DeleteTablet for 3 replicas of tablet 6d77f5aa34d948019c3840f72b3c6a79
I20260807 06:43:32.014665 22739 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d77f5aa34d948019c3840f72b3c6a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:32 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:52770
I20260807 06:43:32.014720 21992 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb: attempting to promote NON_VOTER 52acb6fea02744dc9066cfa3eb05e9af to VOTER
I20260807 06:43:32.014835 21992 consensus_queue.cc:237] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } }
I20260807 06:43:32.015275 23161 tablet_replica.cc:330] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: stopping tablet replica
I20260807 06:43:32.015424 23161 raft_consensus.cc:2229] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:32.015569 22375 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 LEARNER]: Refusing update from remote peer c421ce05bb7446dda6d5ef7ab297f1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 06:43:32.015585 23161 raft_consensus.cc:2258] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:32.015549 22949 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d77f5aa34d948019c3840f72b3c6a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:32 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:52386
I20260807 06:43:32.015765 22524 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d77f5aa34d948019c3840f72b3c6a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:32 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:53426
I20260807 06:43:32.015962 22077 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Refusing update from remote peer c421ce05bb7446dda6d5ef7ab297f1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 06:43:32.015954 21993 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 06:43:32.016155 21993 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 06:43:32.016352 23161 ts_tablet_manager.cc:1905] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:32.016563 21993 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 7 to 12, 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.016952 22077 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 7 to 12, 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.017565 21993 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.017673 21993 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:32.017565 23160 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.017736 21993 sys_catalog.cc:455] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.017820 21993 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:32.017927 23160 sys_catalog.cc:458] T 00000000000000000000000000000000 P c421ce05bb7446dda6d5ef7ab297f1bb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:32.018026 22375 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 7 to 12, 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.018841 23161 ts_tablet_manager.cc:1918] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:32.018927 23161 log.cc:1196] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/6d77f5aa34d948019c3840f72b3c6a79
I20260807 06:43:32.019054 23151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.019336 23151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:43:32.019393 23161 ts_tablet_manager.cc:1939] T 6d77f5aa34d948019c3840f72b3c6a79 P fc66669b33f64094b9106b8703a7a959: Deleting consensus metadata
I20260807 06:43:32.019778 21076 catalog_manager.cc:4841] TS fc66669b33f64094b9106b8703a7a959 (127.11.137.130:35711): tablet 6d77f5aa34d948019c3840f72b3c6a79 (table test-table [id=ed26535b2ac04aabb8d915f16d8b2d77]) successfully deleted
I20260807 06:43:32.019855 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 21042
I20260807 06:43:32.020052 23164 tablet_replica.cc:330] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: stopping tablet replica
I20260807 06:43:32.020110 23163 tablet_replica.cc:330] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: stopping tablet replica
I20260807 06:43:32.022409 23163 raft_consensus.cc:2229] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:32.022501 23163 raft_consensus.cc:2258] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:32.025367 23163 ts_tablet_manager.cc:1905] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:32.028515 23164 raft_consensus.cc:2229] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:32.028651 23164 raft_consensus.cc:2258] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:32.028782 23163 ts_tablet_manager.cc:1918] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:32.028843 23163 log.cc:1196] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/6d77f5aa34d948019c3840f72b3c6a79
I20260807 06:43:32.029067 23163 ts_tablet_manager.cc:1939] T 6d77f5aa34d948019c3840f72b3c6a79 P ea9543ab11c84129891983da282c6496: Deleting consensus metadata
I20260807 06:43:32.030352 23164 ts_tablet_manager.cc:1905] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:32.032135 23164 ts_tablet_manager.cc:1918] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:32.032228 23164 log.cc:1196] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/6d77f5aa34d948019c3840f72b3c6a79
I20260807 06:43:32.032528 23164 ts_tablet_manager.cc:1939] T 6d77f5aa34d948019c3840f72b3c6a79 P 7be4cfd90afd47558e892c1e39bfb46f: Deleting consensus metadata
I20260807 06:43:32.032902 23166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:32.033007 23166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:43:32.034624 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:32.015689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.11.137.188:38597)
0807 06:43:32.015770 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:32.015771 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:32.020016 (+ 4245us) server_negotiation.cc:407] Connection header received
0807 06:43:32.022695 (+ 2679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:32.022696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:32.022706 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:32.022732 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:32.026648 (+ 3916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.027188 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.027948 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.028150 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.028200 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:32.031103 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:32.031104 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:32.031105 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:32.031113 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:32.032973 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:32.033424 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:32.033426 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:32.033426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:32.033481 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:32.033704 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:32.033705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:32.033706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:32.033913 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:32.034015 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:32.034367 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 06:43:32.034481 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 06:43:32.040493 22457 connection.cc:535] server connection from 127.0.0.1:53426 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 06:43:32.040712 22877 connection.cc:535] server connection from 127.0.0.1:52386 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:43:32.049889 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:32.042402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55618 (local address 127.11.137.188:38597)
0807 06:43:32.042436 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:32.042438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:32.042629 (+ 191us) server_negotiation.cc:407] Connection header received
0807 06:43:32.042651 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:32.042652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:32.042661 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:32.042714 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:32.043540 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.043987 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.044926 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.045246 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.045319 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:32.046912 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:32.046913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:32.046913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:32.046921 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:32.048528 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:32.049009 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:32.049010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:32.049011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:32.049085 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:32.049360 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:32.049361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:32.049361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:32.049481 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:32.049604 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:32.049703 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 06:43:32.049775 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:43:32.050179 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:32.042475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46348 (local address 127.11.137.189:36759)
0807 06:43:32.042514 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:32.042516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:32.042728 (+ 212us) server_negotiation.cc:407] Connection header received
0807 06:43:32.042790 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:32.042792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:32.042802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:32.042848 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:32.043554 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.044304 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.045188 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:32.045503 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:32.045575 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:32.046944 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:32.046946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:32.046946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:32.046953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:32.048638 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:32.049120 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:32.049121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:32.049122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:32.049199 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:32.049613 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:32.049614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:32.049614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:32.049743 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:32.049809 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:32.050008 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 06:43:32.050084 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:33.009327 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.009018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:40935)
0807 06:43:33.009157 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.009271 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260807 06:43:33.009375 23184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.008976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:47873)
0807 06:43:33.009128 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.009258 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":64,"threads_started":1}
W20260807 06:43:33.009609 23067 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:34065 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
W20260807 06:43:33.009819 22845 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:34065 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.010486 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.010246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:55455)
0807 06:43:33.010364 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.010442 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":52,"threads_started":1}
W20260807 06:43:33.010680 22624 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:34065 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.517462 23189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c421ce05bb7446dda6d5ef7ab297f1bb)
I20260807 06:43:33.517650 23189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } }
I20260807 06:43:33.517946 23189 leader_election.cc:288] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065), 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188:38597)
I20260807 06:43:33.518313 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.518077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54726)
0807 06:43:33.518210 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.518267 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260807 06:43:33.518471 22039 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.518880 23196 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c421ce05bb7446dda6d5ef7ab297f1bb)
I20260807 06:43:33.519032 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.518936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54734)
0807 06:43:33.518978 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.519004 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 06:43:33.519012 23196 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } }
W20260807 06:43:33.519158 22039 leader_election.cc:334] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065): Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.519286 23196 leader_election.cc:288] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065), 864e0f1045e040e08daf450b3be9bbf5 (127.11.137.189:36759)
I20260807 06:43:33.519527 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.519352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54746)
0807 06:43:33.519457 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.519493 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":51,"threads_started":1}
W20260807 06:43:33.519656 22333 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.520147 23198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.520040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54752)
0807 06:43:33.520081 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.520118 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 06:43:33.520255 22333 leader_election.cc:334] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065): Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.521889 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.518302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55628 (local address 127.11.137.188:38597)
0807 06:43:33.518409 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:33.518411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:33.518420 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:33.518449 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:33.518450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:33.518461 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:33.518535 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:33.518774 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.519551 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.521020 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.521560 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.521626 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.521634 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:33.521789 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:43:33.521823 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":54,"threads_started":1}
I20260807 06:43:33.521912 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.518139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38597 (local address 127.0.0.1:55628)
0807 06:43:33.518231 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.518240 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:33.518318 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:33.518576 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:33.518577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:33.518581 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:33.518672 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.518674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.519674 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.519675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.520940 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.520943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.521641 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.521642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.521712 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.521716 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:33.521777 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:43:33.521819 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":44,"threads_started":1}
I20260807 06:43:33.522248 22375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "864e0f1045e040e08daf450b3be9bbf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "52acb6fea02744dc9066cfa3eb05e9af" is_pre_election: true
I20260807 06:43:33.522373 22375 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 864e0f1045e040e08daf450b3be9bbf5 in term 1.
I20260807 06:43:33.522541 22036 leader_election.cc:302] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52acb6fea02744dc9066cfa3eb05e9af, 864e0f1045e040e08daf450b3be9bbf5; no voters: c421ce05bb7446dda6d5ef7ab297f1bb
I20260807 06:43:33.522673 23189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 06:43:33.522730 23189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c421ce05bb7446dda6d5ef7ab297f1bb)
I20260807 06:43:33.522760 23189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:43:33.522938 23200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.519473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.11.137.189:36759)
0807 06:43:33.519707 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:33.519709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:33.519752 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:43:33.519779 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:33.519780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:33.519792 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:33.519865 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:33.520068 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.520749 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.521911 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.522563 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.522671 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.522679 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:33.522849 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 06:43:33.522890 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":87,"threads_started":1}
I20260807 06:43:33.522969 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.519424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:36759 (local address 127.0.0.1:46350)
0807 06:43:33.519602 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.519612 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:33.519659 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:33.519910 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:33.519912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:33.519917 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:33.519988 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.519990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.520836 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.520837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.521828 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.521831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.522706 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.522708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.522778 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.522783 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:33.522842 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 06:43:33.522890 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":50,"threads_started":1}
I20260807 06:43:33.523305 22077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "52acb6fea02744dc9066cfa3eb05e9af" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "864e0f1045e040e08daf450b3be9bbf5" is_pre_election: true
I20260807 06:43:33.523638 23189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } }
I20260807 06:43:33.523768 22077 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52acb6fea02744dc9066cfa3eb05e9af in current term 2: Already voted for candidate 864e0f1045e040e08daf450b3be9bbf5 in this term.
I20260807 06:43:33.523790 23189 leader_election.cc:288] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [CANDIDATE]: Term 2 election: Requested vote from peers c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065), 52acb6fea02744dc9066cfa3eb05e9af (127.11.137.188:38597)
I20260807 06:43:33.523947 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.523855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54754)
0807 06:43:33.523895 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.523919 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 06:43:33.523947 22375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "864e0f1045e040e08daf450b3be9bbf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "52acb6fea02744dc9066cfa3eb05e9af"
I20260807 06:43:33.524019 22375 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:43:33.524245 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.524173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54760)
0807 06:43:33.524209 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.524231 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260807 06:43:33.524341 22039 leader_election.cc:334] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065): Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
I20260807 06:43:33.524793 22375 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 864e0f1045e040e08daf450b3be9bbf5 in term 2.
I20260807 06:43:33.524920 22330 leader_election.cc:302] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52acb6fea02744dc9066cfa3eb05e9af; no voters: 864e0f1045e040e08daf450b3be9bbf5, c421ce05bb7446dda6d5ef7ab297f1bb
I20260807 06:43:33.524946 22036 leader_election.cc:302] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52acb6fea02744dc9066cfa3eb05e9af, 864e0f1045e040e08daf450b3be9bbf5; no voters: c421ce05bb7446dda6d5ef7ab297f1bb
I20260807 06:43:33.525030 23189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:43:33.525058 23196 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:43:33.525164 23189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [term 2 LEADER]: Becoming Leader. State: Replica: 864e0f1045e040e08daf450b3be9bbf5, State: Running, Role: LEADER
I20260807 06:43:33.525270 23189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } }
I20260807 06:43:33.525638 23203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 864e0f1045e040e08daf450b3be9bbf5. Latest consensus state: current_term: 2 leader_uuid: "864e0f1045e040e08daf450b3be9bbf5" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:33.525740 23203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:33.525930 23205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:33.526373 23205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:33.526437 23205 catalog_manager.cc:1259] Loaded cluster ID: a372f9535f8d450fb7f86c62b0fb569d
I20260807 06:43:33.526453 23205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:33.526568 23205 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:33.526633 23205 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Loaded TSK: 0
I20260807 06:43:33.526719 23205 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:33.535238 22061 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:33.536834 22061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:33.537959 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.537847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54776)
0807 06:43:33.537901 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.537931 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 06:43:33.537988 22375 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [term 2 FOLLOWER]: Refusing update from remote peer 864e0f1045e040e08daf450b3be9bbf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 06:43:33.538269 23189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 06:43:33.538345 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.538269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.0.0.1:54790)
0807 06:43:33.538299 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.538324 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260807 06:43:33.538539 22039 consensus_peers.cc:487] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 -> Peer c421ce05bb7446dda6d5ef7ab297f1bb (127.11.137.190:34065): Couldn't send request to peer c421ce05bb7446dda6d5ef7ab297f1bb. Status: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 06:43:33.538921 23196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 864e0f1045e040e08daf450b3be9bbf5. Latest consensus state: current_term: 2 leader_uuid: "864e0f1045e040e08daf450b3be9bbf5" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:33.539014 23196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:43:33.539419 23206 mvcc.cc:205] Tried to move back new op lower bound from 7315804215449444352 to 7315804215400124416. Current Snapshot: MvccSnapshot[applied={T|T < 7315804215449444352}]
I20260807 06:43:33.539490 23189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "864e0f1045e040e08daf450b3be9bbf5" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:33.539556 23189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:33.539631 23196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "864e0f1045e040e08daf450b3be9bbf5" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "c421ce05bb7446dda6d5ef7ab297f1bb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34065 } } peers { permanent_uuid: "864e0f1045e040e08daf450b3be9bbf5" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 36759 } attrs { promote: false } } peers { permanent_uuid: "52acb6fea02744dc9066cfa3eb05e9af" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38597 } attrs { promote: false } } }
I20260807 06:43:33.539726 23196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52acb6fea02744dc9066cfa3eb05e9af [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:43:33.539724 23207 mvcc.cc:205] Tried to move back new op lower bound from 7315804215449444352 to 7315804215400124416. Current Snapshot: MvccSnapshot[applied={T|T < 7315804215449444352 or (T in {7315804215449444352})}]
I20260807 06:43:33.544525 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.541564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:35711 (local address 127.0.0.1:52780)
0807 06:43:33.541596 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.541608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:33.541701 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:33.541980 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:33.541981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:33.541983 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:33.542031 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.542033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.542731 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.542732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.543526 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.543528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.544248 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.544249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.544311 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.544315 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:33.544397 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:43:33.544457 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":2}
I20260807 06:43:33.544530 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.541691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52780 (local address 127.11.137.130:35711)
0807 06:43:33.541811 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:33.541813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:33.541821 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:33.541846 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:33.541847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:33.541860 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:33.541917 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:33.542105 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.542641 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.543625 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.544165 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.544252 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.544260 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:33.544406 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 06:43:33.544465 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260807 06:43:33.544942 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.541609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36981 (local address 127.0.0.1:53436)
0807 06:43:33.541983 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.541993 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:33.542033 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:33.542166 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:33.542166 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:33.542168 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:33.542197 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.542198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.542809 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.542810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.543917 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.543919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.544713 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.544714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.544780 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.544784 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:33.544829 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 06:43:33.544875 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260807 06:43:33.544989 22739 tablet_service.cc:1467] Processing CreateTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 (DEFAULT_TABLE table=test-table [id=3c38bbd357a543ffa3e30db852995064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:33.545130 22739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80c7beb7e13c418eaccd618248f2d0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:33.545183 23226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.541877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53436 (local address 127.11.137.129:36981)
0807 06:43:33.542026 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:33.542028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:33.542036 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:33.542094 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:33.542095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:33.542105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:33.542162 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:33.542245 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.542727 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.544004 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.544605 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.544673 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.544680 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:33.545043 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 06:43:33.545092 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":51,"threads_started":1}
I20260807 06:43:33.545400 22524 tablet_service.cc:1467] Processing CreateTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 (DEFAULT_TABLE table=test-table [id=3c38bbd357a543ffa3e30db852995064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:33.545537 22524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80c7beb7e13c418eaccd618248f2d0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:33.546452 23227 tablet_bootstrap.cc:492] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Bootstrap starting.
I20260807 06:43:33.546847 23227 tablet_bootstrap.cc:654] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:33.547168 23228 tablet_bootstrap.cc:492] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: Bootstrap starting.
I20260807 06:43:33.547377 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.541506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40247 (local address 127.0.0.1:52396)
0807 06:43:33.541536 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.541548 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:33.541585 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:33.542903 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:33.542904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:33.542906 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:33.542938 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.542939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.543793 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.543794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.544812 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:33.544814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.547128 (+ 2314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.547129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:33.547199 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.547203 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:33.547283 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:43:33.547321 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260807 06:43:33.547415 23225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.541818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52396 (local address 127.11.137.131:40247)
0807 06:43:33.542749 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:33.542751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:33.542757 (+ 6us) server_negotiation.cc:407] Connection header received
0807 06:43:33.542807 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:33.542807 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:33.542819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:33.542885 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:33.542993 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.543701 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.544909 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.547017 (+ 2108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.547109 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.547119 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:33.547293 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 06:43:33.547342 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":910,"thread_start_us":56,"threads_started":1}
I20260807 06:43:33.547658 22949 tablet_service.cc:1467] Processing CreateTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 (DEFAULT_TABLE table=test-table [id=3c38bbd357a543ffa3e30db852995064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:33.547780 22949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80c7beb7e13c418eaccd618248f2d0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:33.549010 23231 tablet_bootstrap.cc:492] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Bootstrap starting.
I20260807 06:43:33.549041 23228 tablet_bootstrap.cc:654] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:33.549531 23231 tablet_bootstrap.cc:654] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:33.549623 23227 tablet_bootstrap.cc:492] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: No bootstrap required, opened a new log
I20260807 06:43:33.549683 23227 ts_tablet_manager.cc:1397] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 06:43:33.549697 23228 tablet_bootstrap.cc:492] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: No bootstrap required, opened a new log
I20260807 06:43:33.549736 23228 ts_tablet_manager.cc:1397] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 06:43:33.549806 23227 raft_consensus.cc:348] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.549845 23228 raft_consensus.cc:348] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.549892 23228 raft_consensus.cc:374] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:33.549892 23227 raft_consensus.cc:374] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:33.549906 23228 raft_consensus.cc:729] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be4cfd90afd47558e892c1e39bfb46f, State: Initialized, Role: FOLLOWER
I20260807 06:43:33.549922 23227 raft_consensus.cc:729] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc66669b33f64094b9106b8703a7a959, State: Initialized, Role: FOLLOWER
I20260807 06:43:33.549939 23228 consensus_queue.cc:260] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.549968 23227 consensus_queue.cc:260] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.550124 23228 ts_tablet_manager.cc:1428] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:33.550134 23227 ts_tablet_manager.cc:1428] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:33.551029 23237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.550280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:45119)
0807 06:43:33.550952 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.550991 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":77,"threads_started":1}
I20260807 06:43:33.551110 22627 heartbeater.cc:503] Master 127.11.137.189:36759 was elected leader, sending a full tablet report...
I20260807 06:43:33.551271 23231 tablet_bootstrap.cc:492] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: No bootstrap required, opened a new log
I20260807 06:43:33.551323 23231 ts_tablet_manager.cc:1397] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 06:43:33.551468 23231 raft_consensus.cc:348] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.551548 23231 raft_consensus.cc:374] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:33.551581 23231 raft_consensus.cc:729] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9543ab11c84129891983da282c6496, State: Initialized, Role: FOLLOWER
I20260807 06:43:33.551630 23231 consensus_queue.cc:260] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.551800 23237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.551418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:39627)
0807 06:43:33.551670 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.551766 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":76,"threads_started":1}
I20260807 06:43:33.551865 23231 ts_tablet_manager.cc:1428] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:33.551915 22846 heartbeater.cc:503] Master 127.11.137.189:36759 was elected leader, sending a full tablet report...
I20260807 06:43:33.552343 23247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.552133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:45351)
0807 06:43:33.552261 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.552300 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":84,"threads_started":1}
I20260807 06:43:33.552479 23068 heartbeater.cc:503] Master 127.11.137.189:36759 was elected leader, sending a full tablet report...
I20260807 06:43:33.552726 23247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.552639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:60843)
0807 06:43:33.552675 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.552698 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 06:43:33.553030 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.550488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:54495)
0807 06:43:33.551230 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.551269 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":102,"threads_started":1}
I20260807 06:43:33.553349 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.553280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:39381)
0807 06:43:33.553308 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.553333 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260807 06:43:33.574433 22628 tablet.cc:2369] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:43:33.628021 23073 tablet.cc:2369] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:33.761123 23236 raft_consensus.cc:482] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:33.761267 23236 raft_consensus.cc:504] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.761433 23236 leader_election.cc:288] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea9543ab11c84129891983da282c6496 (127.11.137.131:40247), 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:33.761673 22988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c7beb7e13c418eaccd618248f2d0f8" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9543ab11c84129891983da282c6496" is_pre_election: true
I20260807 06:43:33.761701 22553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c7beb7e13c418eaccd618248f2d0f8" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be4cfd90afd47558e892c1e39bfb46f" is_pre_election: true
I20260807 06:43:33.761782 22988 raft_consensus.cc:2454] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 0.
I20260807 06:43:33.761785 22553 raft_consensus.cc:2454] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 0.
I20260807 06:43:33.761940 22666 leader_election.cc:302] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be4cfd90afd47558e892c1e39bfb46f, fc66669b33f64094b9106b8703a7a959; no voters:
I20260807 06:43:33.762048 23236 raft_consensus.cc:2781] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:33.762086 23236 raft_consensus.cc:482] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:33.762113 23236 raft_consensus.cc:3037] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:33.762876 23236 raft_consensus.cc:504] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.763008 23236 leader_election.cc:288] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 election: Requested vote from peers ea9543ab11c84129891983da282c6496 (127.11.137.131:40247), 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981)
I20260807 06:43:33.763216 22988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c7beb7e13c418eaccd618248f2d0f8" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9543ab11c84129891983da282c6496"
I20260807 06:43:33.763207 22553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c7beb7e13c418eaccd618248f2d0f8" candidate_uuid: "fc66669b33f64094b9106b8703a7a959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be4cfd90afd47558e892c1e39bfb46f"
I20260807 06:43:33.763293 22988 raft_consensus.cc:3037] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:33.763293 22553 raft_consensus.cc:3037] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:33.764020 22988 raft_consensus.cc:2454] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 1.
I20260807 06:43:33.764020 22553 raft_consensus.cc:2454] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc66669b33f64094b9106b8703a7a959 in term 1.
I20260807 06:43:33.764205 22666 leader_election.cc:302] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be4cfd90afd47558e892c1e39bfb46f, fc66669b33f64094b9106b8703a7a959; no voters:
I20260807 06:43:33.764318 23236 raft_consensus.cc:2781] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:33.764482 23236 raft_consensus.cc:686] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 1 LEADER]: Becoming Leader. State: Replica: fc66669b33f64094b9106b8703a7a959, State: Running, Role: LEADER
I20260807 06:43:33.764569 23236 consensus_queue.cc:237] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } }
I20260807 06:43:33.764871 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.764745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:53507)
0807 06:43:33.764784 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.764823 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260807 06:43:33.765285 22057 catalog_manager.cc:5495] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc66669b33f64094b9106b8703a7a959 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "fc66669b33f64094b9106b8703a7a959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc66669b33f64094b9106b8703a7a959" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 35711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:33.772286 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.769355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52792 (local address 127.11.137.130:35711)
0807 06:43:33.769401 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:33.769404 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:33.769414 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:33.769466 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:33.769467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:33.769477 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:33.769527 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:33.769690 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.770172 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.771600 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:33.771823 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:33.771901 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:33.772052 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:33.772087 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:33.772138 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:33.772186 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 06:43:33.772209 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:43:33.773253 22553 raft_consensus.cc:1261] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Refusing update from remote peer fc66669b33f64094b9106b8703a7a959: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:33.773458 23236 consensus_queue.cc:1035] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be4cfd90afd47558e892c1e39bfb46f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:33.774076 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.773948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:49977)
0807 06:43:33.774004 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.774039 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 06:43:33.774276 22988 raft_consensus.cc:1261] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Refusing update from remote peer fc66669b33f64094b9106b8703a7a959: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:33.774475 23236 consensus_queue.cc:1035] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9543ab11c84129891983da282c6496" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:33.775022 23254 mvcc.cc:205] Tried to move back new op lower bound from 7315804216413536256 to 7315804216380141568. Current Snapshot: MvccSnapshot[applied={T|T < 7315804216413536256}]
I20260807 06:43:33.775329 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.775235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:57829)
0807 06:43:33.775275 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.775300 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 06:43:33.775772 23247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.775667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:43659)
0807 06:43:33.775713 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.775738 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 06:43:33.776263 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.776151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.129:52643)
0807 06:43:33.776202 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.776231 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 06:43:33.776980 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.776870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.130:60613)
0807 06:43:33.776916 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.776944 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 06:43:33.777788 22057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:33.777868 22057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:33.778060 23247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.777953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:34065 (local address 127.11.137.131:33729)
0807 06:43:33.777998 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.778024 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 06:43:33.779249 22057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 864e0f1045e040e08daf450b3be9bbf5: Sending DeleteTablet for 3 replicas of tablet 80c7beb7e13c418eaccd618248f2d0f8
I20260807 06:43:33.779413 22949 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:33 UTC) from {username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:52396
I20260807 06:43:33.779546 22524 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:33 UTC) from {username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:53436
I20260807 06:43:33.779621 23268 tablet_replica.cc:330] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: stopping tablet replica
I20260807 06:43:33.779677 23268 raft_consensus.cc:2229] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:33.779726 23268 raft_consensus.cc:2258] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:33.779737 23269 tablet_replica.cc:330] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: stopping tablet replica
I20260807 06:43:33.779752 22739 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:33 UTC) from {username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:52780
I20260807 06:43:33.779799 23269 raft_consensus.cc:2229] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:33.779872 23269 raft_consensus.cc:2258] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:33.780108 23268 ts_tablet_manager.cc:1905] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:33.780141 23271 tablet_replica.cc:330] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: stopping tablet replica
I20260807 06:43:33.780191 23271 raft_consensus.cc:2229] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:33.780189 23269 ts_tablet_manager.cc:1905] T 80c7beb7e13c418eaccd618248f2d0f8 P 7be4cfd90afd47558e892c1e39bfb46f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:33.780253 23271 raft_consensus.cc:2258] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:33.780335 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 22294
I20260807 06:43:33.782330 23268 ts_tablet_manager.cc:1918] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:33.782460 23268 log.cc:1196] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/80c7beb7e13c418eaccd618248f2d0f8
I20260807 06:43:33.782852 23268 ts_tablet_manager.cc:1939] T 80c7beb7e13c418eaccd618248f2d0f8 P ea9543ab11c84129891983da282c6496: Deleting consensus metadata
I20260807 06:43:33.783121 23271 ts_tablet_manager.cc:1905] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:33.784387 23271 ts_tablet_manager.cc:1918] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:33.784467 23271 log.cc:1196] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/80c7beb7e13c418eaccd618248f2d0f8
I20260807 06:43:33.784699 23271 ts_tablet_manager.cc:1939] T 80c7beb7e13c418eaccd618248f2d0f8 P fc66669b33f64094b9106b8703a7a959: Deleting consensus metadata
I20260807 06:43:33.785178 22039 catalog_manager.cc:4841] TS fc66669b33f64094b9106b8703a7a959 (127.11.137.130:35711): tablet 80c7beb7e13c418eaccd618248f2d0f8 (table test-table [id=3c38bbd357a543ffa3e30db852995064]) successfully deleted
I20260807 06:43:33.790616 22037 catalog_manager.cc:4841] TS ea9543ab11c84129891983da282c6496 (127.11.137.131:40247): tablet 80c7beb7e13c418eaccd618248f2d0f8 (table test-table [id=3c38bbd357a543ffa3e30db852995064]) successfully deleted
I20260807 06:43:33.790663 22949 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c7beb7e13c418eaccd618248f2d0f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:33 UTC) from {username='oryx', principal='oryx/127.11.137.189@KRBTEST.COM'} at 127.0.0.1:52396
W20260807 06:43:33.791363 22037 catalog_manager.cc:4808] TS ea9543ab11c84129891983da282c6496 (127.11.137.131:40247): delete failed for tablet 80c7beb7e13c418eaccd618248f2d0f8 because the tablet was not found. No further retry: Not found: Tablet not found: 80c7beb7e13c418eaccd618248f2d0f8
I20260807 06:43:33.805266 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 22638
I20260807 06:43:33.811846 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:33.805252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36981 (local address 127.0.0.1:53442)
0807 06:43:33.811729 (+ 6477us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:33.811778 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:36981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":604}
W20260807 06:43:33.812036 22037 catalog_manager.cc:4584] TS 7be4cfd90afd47558e892c1e39bfb46f (127.11.137.129:36981): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80c7beb7e13c418eaccd618248f2d0f8: Network error: Client connection negotiation failed: client connection to 127.11.137.129:36981: connect: Connection refused (error 111)
I20260807 06:43:33.822523 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 22853
I20260807 06:43:33.833657 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 21842
I20260807 06:43:33.848893 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 22137
2026-08-07T06:43:33Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4967 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:33 dist-test-slave-8hhm krb5kdc[23276](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:33 dist-test-slave-8hhm krb5kdc[23276](info): set up 2 sockets
Aug 07 06:43:33 dist-test-slave-8hhm krb5kdc[23276](info): commencing operation
krb5kdc: starting...
W20260807 06:43:35.117853 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:35Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab.
Entry for principal oryx/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab.
I20260807 06:43:35.242051 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46041
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab
--principal=oryx/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:46041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:35.326854 23297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:35.327178 23297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:35.327231 23297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:35.328408 23297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:35.328480 23297 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:43:35.328501 23297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:35.328523 23297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:35.328554 23297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:35.328579 23297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:35.330190 23297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:46041
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.190.keytab
--principal=oryx/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:35.330477 23297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:35.330710 23297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:35.335969 23315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.336000 23307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.335969 23311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:35.336263 23297 server_base.cc:1034] running on GCE node
I20260807 06:43:35.336633 23297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:35.337014 23297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:35.338165 23297 hybrid_clock.cc:648] HybridClock initialized: now 1786085015338143 us; error 43 us; skew 500 ppm
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:35.340766 23297 init.cc:377] Logged in from keytab as oryx/127.11.137.190@KRBTEST.COM (short username oryx)
I20260807 06:43:35.341328 23297 webserver.cc:460] Webserver started at http://127.11.137.190:44185/ using document root <none> and password file <none>
I20260807 06:43:35.341562 23297 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:35.341631 23297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:35.341773 23297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:35.342864 23297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "282ed086be47439b8401dc7585a12daf"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "184bc50eb52ae05bd4fe8eb9e5315e0f"
server_key_iv: "48bf2df47889e40d3666d8ef8644400b"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.343266 23297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "282ed086be47439b8401dc7585a12daf"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "184bc50eb52ae05bd4fe8eb9e5315e0f"
server_key_iv: "48bf2df47889e40d3666d8ef8644400b"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.344808 23297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:35.345636 23327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.345809 23297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.345919 23297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "282ed086be47439b8401dc7585a12daf"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "184bc50eb52ae05bd4fe8eb9e5315e0f"
server_key_iv: "48bf2df47889e40d3666d8ef8644400b"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.345999 23297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:35.366851 23297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:35.369428 23297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:35.369604 23297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:35.374586 23297 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:46041
I20260807 06:43:35.374650 23428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:46041 every 8 connection(s)
I20260807 06:43:35.375026 23297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:35.375759 23430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:35.377704 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 23297
I20260807 06:43:35.377808 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:35.378011 11814 external_mini_cluster.cc:1428] Setting key 3261ef249f00ca71fed4a493cf1b7425
I20260807 06:43:35.378782 23430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Bootstrap starting.
I20260807 06:43:35.379458 23430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:35.379853 23430 log.cc:824] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:35.380604 23430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: No bootstrap required, opened a new log
I20260807 06:43:35.383039 23430 raft_consensus.cc:348] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282ed086be47439b8401dc7585a12daf" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46041 } }
I20260807 06:43:35.383270 23430 raft_consensus.cc:374] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:35.383324 23430 raft_consensus.cc:729] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 282ed086be47439b8401dc7585a12daf, State: Initialized, Role: FOLLOWER
I20260807 06:43:35.383486 23430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282ed086be47439b8401dc7585a12daf" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46041 } }
I20260807 06:43:35.383590 23430 raft_consensus.cc:388] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:35.383675 23430 raft_consensus.cc:482] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:35.383723 23430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:35.384505 23430 raft_consensus.cc:504] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282ed086be47439b8401dc7585a12daf" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46041 } }
I20260807 06:43:35.384636 23430 leader_election.cc:302] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 282ed086be47439b8401dc7585a12daf; no voters:
I20260807 06:43:35.384822 23430 leader_election.cc:288] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:35.384876 23435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:35.385035 23435 raft_consensus.cc:686] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [term 1 LEADER]: Becoming Leader. State: Replica: 282ed086be47439b8401dc7585a12daf, State: Running, Role: LEADER
I20260807 06:43:35.385129 23435 consensus_queue.cc:237] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282ed086be47439b8401dc7585a12daf" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46041 } }
I20260807 06:43:35.385196 23430 sys_catalog.cc:564] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:35.385483 23435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 282ed086be47439b8401dc7585a12daf. Latest consensus state: current_term: 1 leader_uuid: "282ed086be47439b8401dc7585a12daf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282ed086be47439b8401dc7585a12daf" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46041 } } }
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:35.385548 23435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:35.385509 23439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "282ed086be47439b8401dc7585a12daf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282ed086be47439b8401dc7585a12daf" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46041 } } }
I20260807 06:43:35.385591 23439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:35.385735 23444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:35.386250 23444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:35.388090 23444 catalog_manager.cc:1347] Generated new cluster ID: 53341489337b40849fb49a44550b7760
I20260807 06:43:35.388145 23444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:35.390440 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.378600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35612 (local address 127.11.137.190:46041)
0807 06:43:35.378786 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.378795 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.378831 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:43:35.379335 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.379343 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.379389 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.379508 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.380369 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.381438 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.382541 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.382946 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.383023 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.386405 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.386410 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.386410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.386424 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.388790 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.389160 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.389163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.389163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.389306 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.389533 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.389534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.389534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.389786 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.389967 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.390074 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.390228 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260807 06:43:35.395996 23444 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:35.396549 23444 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:35.401286 23444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Generated new TSK 0
I20260807 06:43:35.401479 23444 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab.
Entry for principal oryx/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab.
I20260807 06:43:35.430509 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46041
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:35.515092 23473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:35.515347 23473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:35.515388 23473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:35.516561 23473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:35.516637 23473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:35.516672 23473 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:35.516721 23473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:35.518285 23473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:35.518561 23473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:35.518810 23473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:35.523981 23482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.523981 23486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.523999 23484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:35.524211 23473 server_base.cc:1034] running on GCE node
I20260807 06:43:35.524566 23473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:35.524824 23473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:35.526010 23473 hybrid_clock.cc:648] HybridClock initialized: now 1786085015525983 us; error 38 us; skew 500 ppm
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:35.528625 23473 init.cc:377] Logged in from keytab as oryx/127.11.137.129@KRBTEST.COM (short username oryx)
I20260807 06:43:35.529125 23473 webserver.cc:460] Webserver started at http://127.11.137.129:34885/ using document root <none> and password file <none>
I20260807 06:43:35.529397 23473 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:35.529470 23473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:35.529632 23473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:35.530732 23473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "3748ac408562f69ad910d2e233a0f1ef"
server_key_iv: "4c43da6b4e1c582e2dafd56bb0127cda"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.531119 23473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "3748ac408562f69ad910d2e233a0f1ef"
server_key_iv: "4c43da6b4e1c582e2dafd56bb0127cda"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.532966 23473 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:43:35.533795 23504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.533991 23473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.534094 23473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "3748ac408562f69ad910d2e233a0f1ef"
server_key_iv: "4c43da6b4e1c582e2dafd56bb0127cda"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.534188 23473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:35.556022 23473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:35.558079 23473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:35.558254 23473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:35.558892 23473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:35.558943 23473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.558977 23473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:35.559017 23473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:35.567028 23473 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:34957
I20260807 06:43:35.567203 23700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:34957 every 8 connection(s)
I20260807 06:43:35.567451 23473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:35.569656 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.559322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:42827 (local address 127.11.137.190:46041)
0807 06:43:35.559399 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.559401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.559703 (+ 302us) server_negotiation.cc:407] Connection header received
0807 06:43:35.560480 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.560482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.560497 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.560556 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.561569 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.562090 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.563838 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.564080 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.564171 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.566515 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.566517 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.566517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.566525 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.568213 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.568625 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.568627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.568627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.568692 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.568958 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.568959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.568959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.569083 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.569159 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.569464 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.569556 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:43:35.569825 23520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.559331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.11.137.129:42827)
0807 06:43:35.559539 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.559597 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.560355 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.560642 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.560660 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.561089 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:35.561457 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.561465 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.562216 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.562217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.563734 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.563738 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.564201 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.564202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.564332 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.564887 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:35.564895 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:35.566411 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:35.568312 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.568320 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.568322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.568546 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.568760 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.568760 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.568761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.568879 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.569151 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:35.569158 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:35.569329 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.569443 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.569600 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260807 06:43:35.570355 23701 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46041
I20260807 06:43:35.570430 23701 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:35.570623 23701 heartbeater.cc:511] Master 127.11.137.190:46041 requested a full tablet report, sending...
I20260807 06:43:35.571130 23355 ts_manager.cc:194] Registered new tserver with Master: d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957)
I20260807 06:43:35.571853 23355 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:42827
I20260807 06:43:35.576790 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.571445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:44953 (local address 127.11.137.190:46041)
0807 06:43:35.571487 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.571489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.571599 (+ 110us) server_negotiation.cc:407] Connection header received
0807 06:43:35.571670 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.571671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.571681 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.571750 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.572158 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.572627 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.573430 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.573648 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.573737 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.574545 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.574546 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.574547 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.574554 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.575611 (+ 1057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.575961 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.575962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.575963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.576041 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.576260 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.576261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.576261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.576373 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.576445 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.576623 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.576698 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:43:35.576795 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.571383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.11.137.129:44953)
0807 06:43:35.571522 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.571532 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.571614 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.571774 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.571775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.571992 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:35.572062 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.572064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.572729 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.572730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.573324 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.573326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.573738 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.573739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.573807 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.574185 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:35.574190 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:35.574452 (+ 262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:35.575712 (+ 1260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.575713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.575713 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.575885 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.576118 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.576119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.576120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.576184 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.576451 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:35.576452 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:35.576499 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.576578 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.576698 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260807 06:43:35.577207 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 23473
I20260807 06:43:35.577379 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:35.577616 11814 external_mini_cluster.cc:1428] Setting key 1d62866aaf48dcb0f33af8c8198adbc5
WARNING: no policy specified for oryx/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab.
Entry for principal oryx/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab.
I20260807 06:43:35.605978 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46041
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:35.691517 23712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:35.691779 23712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:35.691821 23712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:35.692960 23712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:35.693025 23712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:35.693058 23712 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:35.693099 23712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:35.694693 23712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:35.694980 23712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:35.695232 23712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:35.700471 23718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.700471 23724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.700486 23720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:35.700546 23712 server_base.cc:1034] running on GCE node
I20260807 06:43:35.700927 23712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:35.701180 23712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:35.702380 23712 hybrid_clock.cc:648] HybridClock initialized: now 1786085015702365 us; error 53 us; skew 500 ppm
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:35.705143 23712 init.cc:377] Logged in from keytab as oryx/127.11.137.130@KRBTEST.COM (short username oryx)
I20260807 06:43:35.705679 23712 webserver.cc:460] Webserver started at http://127.11.137.130:45659/ using document root <none> and password file <none>
I20260807 06:43:35.705925 23712 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:35.705992 23712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:35.706154 23712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:35.707207 23712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "1db8850d6b3f4286ad07bb9813a62b24"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "33b790d03d8d34c6eef04cf3b8421ddf"
server_key_iv: "62df41041586809ae206a9b493baffb5"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.707655 23712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "1db8850d6b3f4286ad07bb9813a62b24"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "33b790d03d8d34c6eef04cf3b8421ddf"
server_key_iv: "62df41041586809ae206a9b493baffb5"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.709043 23712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:43:35.709929 23742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.710108 23712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:35.710210 23712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "1db8850d6b3f4286ad07bb9813a62b24"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "33b790d03d8d34c6eef04cf3b8421ddf"
server_key_iv: "62df41041586809ae206a9b493baffb5"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.710294 23712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:35.725802 23712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:35.728299 23712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:35.728461 23712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:35.729034 23712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:35.729094 23712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.729128 23712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:35.729152 23712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:35.737116 23712 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:42319
I20260807 06:43:35.737237 23926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:42319 every 8 connection(s)
I20260807 06:43:35.737602 23712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:35.739384 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.729459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:36407 (local address 127.11.137.190:46041)
0807 06:43:35.729545 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.729548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.729848 (+ 300us) server_negotiation.cc:407] Connection header received
0807 06:43:35.730597 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.730598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.730609 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.730711 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.731657 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.732251 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.733387 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.733599 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.733678 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.736323 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.736329 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.736330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.736337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.738197 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.738579 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.738579 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.738580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.738634 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.738852 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.738853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.738853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.738953 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.739003 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.739257 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.739320 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:43:35.739603 23757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.729453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.11.137.130:36407)
0807 06:43:35.729665 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.729717 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.730477 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.730797 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.730803 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.731209 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:35.731547 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.731556 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.732362 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.732363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.733277 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.733280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.733689 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.733690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.733837 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.734337 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:35.734345 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:35.736239 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:35.738285 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.738289 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.738291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.738509 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.738694 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.738695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.738695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.738797 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.739007 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:35.739012 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:35.739147 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.739230 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.739349 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
I20260807 06:43:35.740141 23927 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46041
I20260807 06:43:35.740221 23927 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:35.740402 23927 heartbeater.cc:511] Master 127.11.137.190:46041 requested a full tablet report, sending...
I20260807 06:43:35.740815 23355 ts_manager.cc:194] Registered new tserver with Master: 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:35.741194 23355 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:36407
I20260807 06:43:35.742097 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 23712
I20260807 06:43:35.742230 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:35.742430 11814 external_mini_cluster.cc:1428] Setting key 199dbafa17a71eecc4da66d9926837f5
I20260807 06:43:35.747058 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.741314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49511 (local address 127.11.137.190:46041)
0807 06:43:35.741353 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.741355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.741472 (+ 117us) server_negotiation.cc:407] Connection header received
0807 06:43:35.741544 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.741545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.741555 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.741599 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.741935 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.742474 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.743309 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.743503 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.743572 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.744462 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.744464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.744464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.744470 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.745857 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.746257 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.746258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.746258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.746328 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.746519 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.746521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.746521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.746661 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.746739 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.746907 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.746973 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:43:35.747071 23934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.741286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.11.137.130:49511)
0807 06:43:35.741415 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.741427 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.741489 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.741613 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.741613 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.741792 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:35.741848 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.741849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.742604 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.742605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.743213 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.743215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.743573 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.743574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.743648 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.744050 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:35.744074 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:35.744354 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:35.745972 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.745973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.745973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.746165 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.746390 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.746391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.746392 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.746450 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.746744 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:35.746745 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:35.746791 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.746866 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.746970 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for oryx/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab.
Entry for principal oryx/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab.
I20260807 06:43:35.770519 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46041
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:35.854332 23937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:35.854540 23937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:35.854564 23937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:35.855654 23937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:35.855691 23937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:35.855711 23937 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:43:35.855728 23937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:35.857191 23937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.137.190:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:35.857518 23937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:35.857774 23937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:43:35.863077 23937 server_base.cc:1034] running on GCE node
W20260807 06:43:35.863059 23948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.863059 23944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:35.863058 23945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:35.863592 23937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:35.863857 23937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:35.865010 23937 hybrid_clock.cc:648] HybridClock initialized: now 1786085015864986 us; error 36 us; skew 500 ppm
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:35.867640 23937 init.cc:377] Logged in from keytab as oryx/127.11.137.131@KRBTEST.COM (short username oryx)
I20260807 06:43:35.868145 23937 webserver.cc:460] Webserver started at http://127.11.137.131:46101/ using document root <none> and password file <none>
I20260807 06:43:35.868383 23937 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:35.868436 23937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:35.868614 23937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:35.869789 23937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "3cf2566db6364a1cb458ac1bc722dd36"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "3d13de36daba74930357063dc51a7945"
server_key_iv: "a80ed0bbcfae75b6e66eee4aa6e9ce7e"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.870229 23937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "3cf2566db6364a1cb458ac1bc722dd36"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "3d13de36daba74930357063dc51a7945"
server_key_iv: "a80ed0bbcfae75b6e66eee4aa6e9ce7e"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.871675 23937 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:35.872416 23959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.872605 23937 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:35.872696 23937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "3cf2566db6364a1cb458ac1bc722dd36"
format_stamp: "Formatted at 2026-08-07 06:43:35 on dist-test-slave-8hhm"
server_key: "3d13de36daba74930357063dc51a7945"
server_key_iv: "a80ed0bbcfae75b6e66eee4aa6e9ce7e"
server_key_version: "encryptionkey@0"
I20260807 06:43:35.872756 23937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:35.887656 23937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:35.890025 23937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:35.890141 23937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:35.890626 23937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:35.890671 23937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.890746 23937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:35.890776 23937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:35.897716 23937 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:37417
I20260807 06:43:35.897785 24172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:37417 every 8 connection(s)
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:35.898106 23937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:35.900846 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.891262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:47409 (local address 127.11.137.190:46041)
0807 06:43:35.891337 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.891339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.891500 (+ 161us) server_negotiation.cc:407] Connection header received
0807 06:43:35.892031 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.892033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.892047 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.892130 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.893035 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.893933 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.895537 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.895849 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.895928 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.898596 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.898597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.898597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.898605 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.899738 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.900116 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.900117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.900117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.900172 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.900376 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.900377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.900377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.900481 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.900532 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.900721 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.900783 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:43:35.901021 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.891221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.11.137.131:47409)
0807 06:43:35.891371 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.891411 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.891930 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.892222 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.892225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.892622 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:35.892919 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.892925 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.894038 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.894040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.895440 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.895444 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.895954 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.895955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.896059 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.896622 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:35.896633 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:35.898470 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:35.899816 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.899822 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.899823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.900044 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.900231 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.900231 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.900232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.900324 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.900520 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:35.900523 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:35.900628 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.900709 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.900823 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260807 06:43:35.901695 24173 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46041
I20260807 06:43:35.901785 24173 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:35.901960 24173 heartbeater.cc:511] Master 127.11.137.190:46041 requested a full tablet report, sending...
I20260807 06:43:35.902374 23349 ts_manager.cc:194] Registered new tserver with Master: 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417)
I20260807 06:43:35.902789 23349 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:47409
I20260807 06:43:35.905938 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 23937
I20260807 06:43:35.906073 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:35.906276 11814 external_mini_cluster.cc:1428] Setting key 1739f41cf0905eb9297d2c17ef30536f
I20260807 06:43:35.907173 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:35.908318 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.902758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.11.137.131:50961)
0807 06:43:35.902918 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.902929 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.903004 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.903147 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.903148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.903310 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:35.903367 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.903368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.904043 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.904044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.904531 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.904532 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.904852 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.904853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.904898 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.905307 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:35.905312 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:35.905597 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:35.907386 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.907387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.907387 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.907553 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.907762 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:35.907763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:35.907763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:35.907817 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:35.908084 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:35.908085 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:35.908120 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.908169 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.908249 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260807 06:43:35.908411 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.902822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:50961 (local address 127.11.137.190:46041)
0807 06:43:35.902868 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.902870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.902980 (+ 110us) server_negotiation.cc:407] Connection header received
0807 06:43:35.903058 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.903059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.903068 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.903142 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.903443 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.903949 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.904609 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.904788 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.904837 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.905676 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.905677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.905677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.905691 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.907311 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.907627 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.907628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.907629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.907695 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.907879 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.907880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.907880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.908021 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.908091 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.908196 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.908273 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:43:35.934607 23433 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:35.929135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35616 (local address 127.11.137.190:46041)
0807 06:43:35.929264 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.929266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.929276 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:35.929306 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.929307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.929318 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.929386 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.930003 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.930494 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.931195 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.931381 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.931442 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.934481 (+ 3039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35616: BlockingRecv error: recv got EOF from 127.0.0.1:35616 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 06:43:35 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:35.942337 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.935423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35632 (local address 127.11.137.190:46041)
0807 06:43:35.935485 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.935487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.935548 (+ 61us) server_negotiation.cc:407] Connection header received
0807 06:43:35.935571 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.935572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.935582 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.935633 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:35.936047 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.936567 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.937279 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.937488 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.937547 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.939666 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:35.939668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:35.939668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:35.939678 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:35.940990 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.941460 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.941461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.941461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.941522 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:35.941772 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:35.941774 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:35.941774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:35.941891 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:35.941999 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.942157 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.942233 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:35.943992 23349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:35.945640 23349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:35.952590 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.948000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:37417 (local address 127.0.0.1:33532)
0807 06:43:35.948395 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.948404 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.948443 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.948737 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.948741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.948743 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:35.948814 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.948816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.950154 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.950155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.951405 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.951407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.952288 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.952289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.952337 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.952351 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.952433 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.952495 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":62,"thread_start_us":72,"threads_started":1}
I20260807 06:43:35.952611 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.948089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44430 (local address 127.11.137.130:42319)
0807 06:43:35.948694 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.948700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.948711 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:43:35.948752 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.948754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.948768 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.949026 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:35.949143 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.950250 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.951349 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.952135 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.952242 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.952313 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.952460 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.952503 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":125,"threads_started":1}
I20260807 06:43:35.952590 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.947992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:42319 (local address 127.0.0.1:44430)
0807 06:43:35.948179 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.948223 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.948290 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.948903 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.948904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.948906 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:35.948950 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.948952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.950332 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.950334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.951246 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.951249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.952229 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.952230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.952335 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.952351 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.952433 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.952495 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":66,"threads_started":1}
I20260807 06:43:35.952981 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.948253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33532 (local address 127.11.137.131:37417)
0807 06:43:35.948433 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.948439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.948452 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:43:35.948496 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.948498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.948516 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.948644 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:35.948901 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.950060 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.951497 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.952209 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.952292 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.952338 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.952729 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.952769 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260807 06:43:35.953491 24203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.948000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:34957 (local address 127.0.0.1:58680)
0807 06:43:35.948305 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:35.948315 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:35.948357 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:35.949003 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:35.949004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:35.949006 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:35.949052 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.949053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.950018 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.950019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.951404 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:35.951407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.953252 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.953253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:35.953315 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.953319 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:35.953386 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 06:43:35.953425 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":30,"thread_start_us":110,"threads_started":1}
I20260807 06:43:35.953536 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:35.948471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58680 (local address 127.11.137.129:34957)
0807 06:43:35.948757 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:35.948762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:35.948772 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:35.948812 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:35.948814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:35.948831 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:35.948934 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:35.949126 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.949878 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.952384 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:35.953151 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:35.953274 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:35.953332 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:35.953401 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 06:43:35.953440 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":92,"threads_started":1}
I20260807 06:43:35.953685 23821 tablet_service.cc:1467] Processing CreateTablet for tablet f2c54c233f5f417f8d48abc9a91594f8 (DEFAULT_TABLE table=test-table [id=99d6192ecc03438da830cab0e319ece9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:35.953685 24050 tablet_service.cc:1467] Processing CreateTablet for tablet f2c54c233f5f417f8d48abc9a91594f8 (DEFAULT_TABLE table=test-table [id=99d6192ecc03438da830cab0e319ece9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:35.954067 24050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2c54c233f5f417f8d48abc9a91594f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:35.954082 23821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2c54c233f5f417f8d48abc9a91594f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:35.954447 23589 tablet_service.cc:1467] Processing CreateTablet for tablet f2c54c233f5f417f8d48abc9a91594f8 (DEFAULT_TABLE table=test-table [id=99d6192ecc03438da830cab0e319ece9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:35.954784 23589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2c54c233f5f417f8d48abc9a91594f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:35.957010 24215 tablet_bootstrap.cc:492] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Bootstrap starting.
I20260807 06:43:35.957787 24215 tablet_bootstrap.cc:654] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:35.958154 24215 log.cc:824] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:35.958276 24216 tablet_bootstrap.cc:492] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Bootstrap starting.
I20260807 06:43:35.958807 24220 tablet_bootstrap.cc:492] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Bootstrap starting.
I20260807 06:43:35.959051 24216 tablet_bootstrap.cc:654] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:35.959167 24215 tablet_bootstrap.cc:492] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: No bootstrap required, opened a new log
I20260807 06:43:35.959250 24215 ts_tablet_manager.cc:1397] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:35.959439 24220 tablet_bootstrap.cc:654] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:35.959437 24216 log.cc:824] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:35.959808 24220 log.cc:824] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:35.960182 24216 tablet_bootstrap.cc:492] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: No bootstrap required, opened a new log
I20260807 06:43:35.960233 24216 ts_tablet_manager.cc:1397] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:35.960989 24220 tablet_bootstrap.cc:492] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: No bootstrap required, opened a new log
I20260807 06:43:35.961062 24220 ts_tablet_manager.cc:1397] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:35.961370 24215 raft_consensus.cc:348] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:35.961522 24215 raft_consensus.cc:374] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:35.961566 24215 raft_consensus.cc:729] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Initialized, Role: FOLLOWER
I20260807 06:43:35.961691 24215 consensus_queue.cc:260] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:35.961968 24215 ts_tablet_manager.cc:1428] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:35.962116 24173 heartbeater.cc:503] Master 127.11.137.190:46041 was elected leader, sending a full tablet report...
I20260807 06:43:35.962155 24216 raft_consensus.cc:348] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:35.962319 24216 raft_consensus.cc:374] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:35.962368 24216 raft_consensus.cc:729] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db8850d6b3f4286ad07bb9813a62b24, State: Initialized, Role: FOLLOWER
I20260807 06:43:35.962477 24216 consensus_queue.cc:260] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:35.962740 24216 ts_tablet_manager.cc:1428] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:43:35.962771 23927 heartbeater.cc:503] Master 127.11.137.190:46041 was elected leader, sending a full tablet report...
I20260807 06:43:35.963124 24220 raft_consensus.cc:348] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:35.963311 24220 raft_consensus.cc:374] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:35.963361 24220 raft_consensus.cc:729] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4dbbd9a11c34eb59e577e40ba93d245, State: Initialized, Role: FOLLOWER
I20260807 06:43:35.963474 24220 consensus_queue.cc:260] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:35.963747 24220 ts_tablet_manager.cc:1428] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:35.963887 23701 heartbeater.cc:503] Master 127.11.137.190:46041 was elected leader, sending a full tablet report...
W20260807 06:43:35.988245 23928 tablet.cc:2369] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:43:36.068272 23702 tablet.cc:2369] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:43:36.148761 24174 tablet.cc:2369] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:43:36.156308 24228 raft_consensus.cc:482] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:36.156476 24228 raft_consensus.cc:504] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:36.156973 24228 leader_election.cc:288] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417), d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957)
I20260807 06:43:36.161176 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.157399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:37897 (local address 127.11.137.129:34957)
0807 06:43:36.157470 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.157471 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.157500 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:43:36.157538 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.157539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.157549 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.157622 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:36.157848 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.158617 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.160166 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.160729 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.160818 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.160827 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.161080 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.161120 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:43:36.161199 23757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.157179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:34957 (local address 127.11.137.130:37897)
0807 06:43:36.157269 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.157289 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.157361 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.157651 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.157651 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.157653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:36.157759 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.157762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.158721 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.158722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.160051 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.160054 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.160827 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.160828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.160967 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.160972 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.161044 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.161097 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":131}
I20260807 06:43:36.161599 24232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.157190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:37417 (local address 127.11.137.130:49685)
0807 06:43:36.157417 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.157428 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.157498 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.157650 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.157651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.157653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:36.157769 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.157770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.158721 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.158722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.160051 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.160054 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.160827 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.160828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.161371 (+ 543us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.161376 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.161466 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.161512 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":48,"thread_start_us":124,"threads_started":1}
I20260807 06:43:36.161612 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.157299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49685 (local address 127.11.137.131:37417)
0807 06:43:36.157380 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.157382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.157517 (+ 135us) server_negotiation.cc:407] Connection header received
0807 06:43:36.157550 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.157551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.157562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.157626 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:36.157854 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.158624 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.160171 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.160729 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.160818 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.160827 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.161501 (+ 674us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.161550 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:43:36.161625 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c54c233f5f417f8d48abc9a91594f8" candidate_uuid: "1db8850d6b3f4286ad07bb9813a62b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" is_pre_election: true
I20260807 06:43:36.161818 23614 raft_consensus.cc:2454] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db8850d6b3f4286ad07bb9813a62b24 in term 0.
I20260807 06:43:36.161955 24083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c54c233f5f417f8d48abc9a91594f8" candidate_uuid: "1db8850d6b3f4286ad07bb9813a62b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cf2566db6364a1cb458ac1bc722dd36" is_pre_election: true
I20260807 06:43:36.162110 24083 raft_consensus.cc:2454] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db8850d6b3f4286ad07bb9813a62b24 in term 0.
I20260807 06:43:36.162110 23749 leader_election.cc:302] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db8850d6b3f4286ad07bb9813a62b24, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.162274 24228 raft_consensus.cc:2781] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:36.162320 24228 raft_consensus.cc:482] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:36.162336 24228 raft_consensus.cc:3037] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.163071 24228 raft_consensus.cc:504] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:36.163226 24228 leader_election.cc:288] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [CANDIDATE]: Term 1 election: Requested vote from peers 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417), d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957)
I20260807 06:43:36.163405 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c54c233f5f417f8d48abc9a91594f8" candidate_uuid: "1db8850d6b3f4286ad07bb9813a62b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
I20260807 06:43:36.163443 24083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c54c233f5f417f8d48abc9a91594f8" candidate_uuid: "1db8850d6b3f4286ad07bb9813a62b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cf2566db6364a1cb458ac1bc722dd36"
I20260807 06:43:36.163499 23614 raft_consensus.cc:3037] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.163534 24083 raft_consensus.cc:3037] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.164242 24083 raft_consensus.cc:2454] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db8850d6b3f4286ad07bb9813a62b24 in term 1.
I20260807 06:43:36.164289 23614 raft_consensus.cc:2454] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db8850d6b3f4286ad07bb9813a62b24 in term 1.
I20260807 06:43:36.164475 23748 leader_election.cc:302] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db8850d6b3f4286ad07bb9813a62b24, 3cf2566db6364a1cb458ac1bc722dd36; no voters:
I20260807 06:43:36.164587 24228 raft_consensus.cc:2781] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:36.164793 24228 raft_consensus.cc:686] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 LEADER]: Becoming Leader. State: Replica: 1db8850d6b3f4286ad07bb9813a62b24, State: Running, Role: LEADER
I20260807 06:43:36.164893 24228 consensus_queue.cc:237] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } }
I20260807 06:43:36.166025 23355 catalog_manager.cc:5495] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "1db8850d6b3f4286ad07bb9813a62b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } health_report { overall_health: UNKNOWN } } }
I20260807 06:43:36.181931 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.179379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.11.137.130:42319)
0807 06:43:36.179437 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.179440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.179448 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:36.179522 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.179523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.179545 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.179639 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.179797 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.180267 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.181036 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.181293 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.181371 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.181558 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.181672 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.181764 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.181806 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.181826 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:43:36.183826 24083 raft_consensus.cc:1261] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Refusing update from remote peer 1db8850d6b3f4286ad07bb9813a62b24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.183826 23614 raft_consensus.cc:1261] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Refusing update from remote peer 1db8850d6b3f4286ad07bb9813a62b24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.184195 24234 consensus_queue.cc:1035] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.184353 24228 consensus_queue.cc:1035] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.187049 24246 mvcc.cc:205] Tried to move back new op lower bound from 7315804226285703168 to 7315804226212806656. Current Snapshot: MvccSnapshot[applied={T|T < 7315804226285703168}]
I20260807 06:43:36.189477 23349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.189581 23349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.190373 23349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Sending DeleteTablet for 3 replicas of tablet f2c54c233f5f417f8d48abc9a91594f8
I20260807 06:43:36.190703 23821 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c54c233f5f417f8d48abc9a91594f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:44430
I20260807 06:43:36.190747 24050 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c54c233f5f417f8d48abc9a91594f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:33532
I20260807 06:43:36.190934 24265 tablet_replica.cc:330] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: stopping tablet replica
I20260807 06:43:36.190961 23589 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c54c233f5f417f8d48abc9a91594f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:58680
I20260807 06:43:36.191032 24265 raft_consensus.cc:2229] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:36.191064 23349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:43:36.191148 24265 raft_consensus.cc:2258] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 06:43:36.191200 23349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:36.191533 24266 tablet_replica.cc:330] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: stopping tablet replica
I20260807 06:43:36.191694 24266 raft_consensus.cc:2229] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.191746 24265 ts_tablet_manager.cc:1905] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.192173 24266 raft_consensus.cc:2258] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.192569 23821 tablet_service.cc:1467] Processing CreateTablet for tablet f1e964e579664977abca6e3cc2a31b90 (DEFAULT_TABLE table=test-table [id=33271293f7934cc7a377473993907e2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.192652 24266 ts_tablet_manager.cc:1905] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.192786 23821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e964e579664977abca6e3cc2a31b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.193511 24265 ts_tablet_manager.cc:1918] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:36.193594 24265 log.cc:1196] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/f2c54c233f5f417f8d48abc9a91594f8
I20260807 06:43:36.193893 24265 ts_tablet_manager.cc:1939] T f2c54c233f5f417f8d48abc9a91594f8 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting consensus metadata
I20260807 06:43:36.194235 24216 tablet_bootstrap.cc:492] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Bootstrap starting.
I20260807 06:43:36.194662 24216 tablet_bootstrap.cc:654] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.194708 24266 ts_tablet_manager.cc:1918] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:36.194774 24266 log.cc:1196] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/f2c54c233f5f417f8d48abc9a91594f8
I20260807 06:43:36.195044 24266 ts_tablet_manager.cc:1939] T f2c54c233f5f417f8d48abc9a91594f8 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting consensus metadata
I20260807 06:43:36.195179 23333 catalog_manager.cc:4841] TS 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319): tablet f2c54c233f5f417f8d48abc9a91594f8 (table test-table [id=99d6192ecc03438da830cab0e319ece9]) successfully deleted
I20260807 06:43:36.195436 23589 tablet_service.cc:1467] Processing CreateTablet for tablet f1e964e579664977abca6e3cc2a31b90 (DEFAULT_TABLE table=test-table [id=33271293f7934cc7a377473993907e2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.195566 23589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e964e579664977abca6e3cc2a31b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.195528 23330 catalog_manager.cc:4841] TS 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417): tablet f2c54c233f5f417f8d48abc9a91594f8 (table test-table [id=99d6192ecc03438da830cab0e319ece9]) successfully deleted
I20260807 06:43:36.195869 24216 tablet_bootstrap.cc:492] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: No bootstrap required, opened a new log
I20260807 06:43:36.195947 24216 ts_tablet_manager.cc:1397] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:36.196103 24216 raft_consensus.cc:348] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.196182 24216 raft_consensus.cc:374] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.196209 24216 raft_consensus.cc:729] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db8850d6b3f4286ad07bb9813a62b24, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.196251 24216 consensus_queue.cc:260] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.196343 24216 ts_tablet_manager.cc:1428] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:36.196921 24220 tablet_bootstrap.cc:492] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Bootstrap starting.
I20260807 06:43:36.196920 24268 tablet_replica.cc:330] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: stopping tablet replica
I20260807 06:43:36.196983 24050 tablet_service.cc:1467] Processing CreateTablet for tablet f1e964e579664977abca6e3cc2a31b90 (DEFAULT_TABLE table=test-table [id=33271293f7934cc7a377473993907e2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.197054 24268 raft_consensus.cc:2229] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.197089 24050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e964e579664977abca6e3cc2a31b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.197168 24268 raft_consensus.cc:2258] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.197340 24220 tablet_bootstrap.cc:654] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.197671 24268 ts_tablet_manager.cc:1905] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.198359 24215 tablet_bootstrap.cc:492] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Bootstrap starting.
I20260807 06:43:36.198763 24215 tablet_bootstrap.cc:654] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.198849 24220 tablet_bootstrap.cc:492] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: No bootstrap required, opened a new log
I20260807 06:43:36.198894 24220 ts_tablet_manager.cc:1397] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 06:43:36.199041 24220 raft_consensus.cc:348] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.199107 24220 raft_consensus.cc:374] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.199136 24220 raft_consensus.cc:729] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4dbbd9a11c34eb59e577e40ba93d245, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.199191 24220 consensus_queue.cc:260] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.199292 24268 ts_tablet_manager.cc:1918] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:36.199385 24268 log.cc:1196] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/f2c54c233f5f417f8d48abc9a91594f8
I20260807 06:43:36.199656 24215 tablet_bootstrap.cc:492] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: No bootstrap required, opened a new log
I20260807 06:43:36.199709 24215 ts_tablet_manager.cc:1397] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:36.199303 24220 ts_tablet_manager.cc:1428] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:36.199885 24215 raft_consensus.cc:348] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.199961 24215 raft_consensus.cc:374] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.199982 24215 raft_consensus.cc:729] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.200027 24215 consensus_queue.cc:260] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.200058 24268 ts_tablet_manager.cc:1939] T f2c54c233f5f417f8d48abc9a91594f8 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting consensus metadata
I20260807 06:43:36.200135 24215 ts_tablet_manager.cc:1428] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:36.200488 23331 catalog_manager.cc:4841] TS d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957): tablet f2c54c233f5f417f8d48abc9a91594f8 (table test-table [id=99d6192ecc03438da830cab0e319ece9]) successfully deleted
I20260807 06:43:36.223701 24229 raft_consensus.cc:482] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:36.223836 24229 raft_consensus.cc:504] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.224239 24229 leader_election.cc:288] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319), 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417)
I20260807 06:43:36.227641 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.224409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:37417 (local address 127.11.137.129:53255)
0807 06:43:36.224580 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.224591 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.224654 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.224864 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.224865 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.224867 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:36.224953 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.224955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.225957 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.225958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.226760 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.226763 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.227359 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.227360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.227441 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.227445 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.227502 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.227543 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":59,"threads_started":1}
I20260807 06:43:36.227651 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.224576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:53255 (local address 127.11.137.131:37417)
0807 06:43:36.224632 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.224634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.224643 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:36.224781 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.224782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.224793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.224851 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:36.225032 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.225840 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.226860 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.227227 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.227316 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.227325 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.227529 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.227576 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 06:43:36.228229 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.224470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:33197 (local address 127.11.137.130:42319)
0807 06:43:36.224523 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.224526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.224696 (+ 170us) server_negotiation.cc:407] Connection header received
0807 06:43:36.224813 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.224814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.224825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.224875 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:36.225067 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.225841 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.227299 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.227860 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.227932 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.227939 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.228123 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.228168 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:43:36.228230 24272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.224421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:42319 (local address 127.11.137.129:33197)
0807 06:43:36.224639 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.224649 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.224723 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.224924 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.224925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.224927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:36.225000 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.225002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.225929 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.225930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.227198 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.227201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.227964 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.227965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.228041 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.228045 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.228102 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.228141 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":21,"thread_start_us":97,"threads_started":1}
I20260807 06:43:36.228223 24083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e964e579664977abca6e3cc2a31b90" candidate_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cf2566db6364a1cb458ac1bc722dd36" is_pre_election: true
I20260807 06:43:36.228328 24083 raft_consensus.cc:2454] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4dbbd9a11c34eb59e577e40ba93d245 in term 0.
I20260807 06:43:36.228636 23508 leader_election.cc:302] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.228602 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e964e579664977abca6e3cc2a31b90" candidate_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24" is_pre_election: true
I20260807 06:43:36.228750 23844 raft_consensus.cc:2454] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4dbbd9a11c34eb59e577e40ba93d245 in term 0.
I20260807 06:43:36.228789 24229 raft_consensus.cc:2781] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:36.228821 24229 raft_consensus.cc:482] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:36.228850 24229 raft_consensus.cc:3037] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.229668 24229 raft_consensus.cc:504] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.229821 24229 leader_election.cc:288] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [CANDIDATE]: Term 1 election: Requested vote from peers 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319), 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417)
I20260807 06:43:36.230041 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e964e579664977abca6e3cc2a31b90" candidate_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24"
I20260807 06:43:36.230140 23844 raft_consensus.cc:3037] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.230161 24083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e964e579664977abca6e3cc2a31b90" candidate_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cf2566db6364a1cb458ac1bc722dd36"
I20260807 06:43:36.230252 24083 raft_consensus.cc:3037] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.230851 24083 raft_consensus.cc:2454] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4dbbd9a11c34eb59e577e40ba93d245 in term 1.
I20260807 06:43:36.230978 23844 raft_consensus.cc:2454] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4dbbd9a11c34eb59e577e40ba93d245 in term 1.
I20260807 06:43:36.231021 23508 leader_election.cc:302] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.231112 24229 raft_consensus.cc:2781] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:36.231283 24229 raft_consensus.cc:686] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 LEADER]: Becoming Leader. State: Replica: d4dbbd9a11c34eb59e577e40ba93d245, State: Running, Role: LEADER
I20260807 06:43:36.231362 24229 consensus_queue.cc:237] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.232124 23349 catalog_manager.cc:5495] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:43:36 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085015, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.190@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:36.269649 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.262113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.11.137.190:46041)
0807 06:43:36.262186 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.262189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.262317 (+ 128us) server_negotiation.cc:407] Connection header received
0807 06:43:36.262391 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.262392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.262410 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.262485 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:36.262960 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.263445 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.264158 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.264340 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.264445 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.266666 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:36.266668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:36.266669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:36.266677 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:36.268296 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:36.268734 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:36.268735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:36.268735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:36.268796 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:36.268995 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:36.268996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:36.268997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:36.269113 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:36.269187 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.269387 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.269518 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":42}
I20260807 06:43:36.269728 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.262036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46041 (local address 127.0.0.1:35634)
0807 06:43:36.262236 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.262246 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.262333 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.262490 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.262491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.262813 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:36.262859 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.262862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.263528 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.263530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.264045 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.264047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.264445 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.264446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.264502 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.265125 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:36.265130 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:36.266554 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:36.268406 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:36.268413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:36.268415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:36.268634 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:36.268865 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:36.268866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:36.268866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:36.268928 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:36.269189 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:36.269197 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:36.269273 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.269363 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.269585 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":106,"thread_start_us":90,"threads_started":1}
I20260807 06:43:36.272505 23349 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:35634:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:43:36.272727 23349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:36.274318 23821 tablet_service.cc:1467] Processing CreateTablet for tablet 3316cce08a7d4a43b2e5240b78afd931 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=530ab76b8f4e43c08a68e27c6f0f91bf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:36.274329 24050 tablet_service.cc:1467] Processing CreateTablet for tablet 3316cce08a7d4a43b2e5240b78afd931 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=530ab76b8f4e43c08a68e27c6f0f91bf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:36.274508 24050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3316cce08a7d4a43b2e5240b78afd931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.274508 23821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3316cce08a7d4a43b2e5240b78afd931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.275890 24216 tablet_bootstrap.cc:492] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: Bootstrap starting.
I20260807 06:43:36.276306 24216 tablet_bootstrap.cc:654] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.276432 23589 tablet_service.cc:1467] Processing CreateTablet for tablet 3316cce08a7d4a43b2e5240b78afd931 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=530ab76b8f4e43c08a68e27c6f0f91bf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:43:36.276594 23589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3316cce08a7d4a43b2e5240b78afd931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.276988 24216 tablet_bootstrap.cc:492] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: No bootstrap required, opened a new log
I20260807 06:43:36.277056 24216 ts_tablet_manager.cc:1397] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:36.277308 24215 tablet_bootstrap.cc:492] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: Bootstrap starting.
I20260807 06:43:36.277276 24216 raft_consensus.cc:348] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.277354 24216 raft_consensus.cc:374] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.277376 24216 raft_consensus.cc:729] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db8850d6b3f4286ad07bb9813a62b24, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.277418 24216 consensus_queue.cc:260] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.277539 24216 ts_tablet_manager.cc:1428] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:36.277655 24255 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.277750 24255 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.277784 24215 tablet_bootstrap.cc:654] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.278241 24220 tablet_bootstrap.cc:492] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: Bootstrap starting.
I20260807 06:43:36.278652 24220 tablet_bootstrap.cc:654] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.279384 24215 tablet_bootstrap.cc:492] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: No bootstrap required, opened a new log
I20260807 06:43:36.279405 24220 tablet_bootstrap.cc:492] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: No bootstrap required, opened a new log
I20260807 06:43:36.279450 24220 ts_tablet_manager.cc:1397] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:36.279449 24215 ts_tablet_manager.cc:1397] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:43:36.279595 24220 raft_consensus.cc:348] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.279672 24220 raft_consensus.cc:374] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.279632 24215 raft_consensus.cc:348] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.279704 24220 raft_consensus.cc:729] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4dbbd9a11c34eb59e577e40ba93d245, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.279712 24215 raft_consensus.cc:374] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.279734 24215 raft_consensus.cc:729] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.279752 24220 consensus_queue.cc:260] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.279772 24215 consensus_queue.cc:260] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.279837 24220 ts_tablet_manager.cc:1428] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:36.279852 24215 ts_tablet_manager.cc:1428] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:36.279946 24229 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.279949 24226 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.280014 24229 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.280035 24226 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.292841 24226 raft_consensus.cc:482] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:36.292932 24226 raft_consensus.cc:504] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.293283 24226 leader_election.cc:288] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957), 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:36.296856 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.293418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:34957 (local address 127.11.137.131:49223)
0807 06:43:36.293513 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.293525 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.293565 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.293860 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.293861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.293863 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:36.293930 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.293932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.294658 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.294660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.295877 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.295880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.296596 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.296597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.296680 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.296684 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.296743 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.296781 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 06:43:36.296877 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.293655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49223 (local address 127.11.137.129:34957)
0807 06:43:36.293710 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.293712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.293720 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:36.293748 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.293748 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.293759 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.293810 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:36.294036 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.294570 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.295983 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.296502 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.296589 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.296599 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.296767 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.296811 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:36.297132 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3316cce08a7d4a43b2e5240b78afd931" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" is_pre_election: true
I20260807 06:43:36.297261 23614 raft_consensus.cc:2454] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 0.
I20260807 06:43:36.297441 24294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.293448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:42319 (local address 127.11.137.131:52931)
0807 06:43:36.293748 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.293758 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.293801 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.293998 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.293999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.294001 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:36.294071 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.294072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.294918 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.294919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.296260 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.296262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.297079 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.297080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.297151 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.297156 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.297297 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.297360 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":156,"threads_started":1}
I20260807 06:43:36.297533 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.293736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:52931 (local address 127.11.137.130:42319)
0807 06:43:36.293780 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.293782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.293794 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:36.293904 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.293905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.293917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.293983 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:36.294150 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.294827 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.296353 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.296836 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.296897 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.296906 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.297424 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.297468 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:36.297452 23968 leader_election.cc:302] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.297744 24226 raft_consensus.cc:2781] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:36.297798 24226 raft_consensus.cc:482] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:36.297822 24226 raft_consensus.cc:3037] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.297856 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3316cce08a7d4a43b2e5240b78afd931" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24" is_pre_election: true
I20260807 06:43:36.297937 23844 raft_consensus.cc:2454] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 0.
I20260807 06:43:36.298635 24226 raft_consensus.cc:504] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.298775 24226 leader_election.cc:288] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 election: Requested vote from peers d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957), 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:36.298990 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3316cce08a7d4a43b2e5240b78afd931" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
I20260807 06:43:36.299098 23614 raft_consensus.cc:3037] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.299139 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3316cce08a7d4a43b2e5240b78afd931" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24"
I20260807 06:43:36.299225 23844 raft_consensus.cc:3037] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.299753 23614 raft_consensus.cc:2454] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 1.
I20260807 06:43:36.299933 23968 leader_election.cc:302] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.300024 23844 raft_consensus.cc:2454] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 1.
I20260807 06:43:36.300063 24226 raft_consensus.cc:2781] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:36.300246 24226 raft_consensus.cc:686] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 LEADER]: Becoming Leader. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Running, Role: LEADER
I20260807 06:43:36.300333 24226 consensus_queue.cc:237] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.300711 24295 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: TxnStatusTablet state changed. Reason: New leader 3cf2566db6364a1cb458ac1bc722dd36. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.300866 24295 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:36.301131 24300 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:43:36.301067 23347 catalog_manager.cc:5495] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:36.301283 24300 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:43:36.310776 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.307419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33536 (local address 127.11.137.131:37417)
0807 06:43:36.307464 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.307466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.307475 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:36.307573 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.307574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.307592 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.307658 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.307841 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.308557 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.309705 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.310053 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.310128 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.310389 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.310501 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.310575 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.310647 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.310696 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:43:36.310791 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.307358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:37417 (local address 127.0.0.1:33536)
0807 06:43:36.307428 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.307439 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.307482 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.307662 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.307663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.307664 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:36.307766 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.307769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.308656 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.308658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.309596 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.309600 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.310153 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.310154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.310264 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.310283 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.310581 (+ 298us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.310591 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.310644 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.310714 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 06:43:36.312193 23614 raft_consensus.cc:1261] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Refusing update from remote peer 3cf2566db6364a1cb458ac1bc722dd36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.312230 23844 raft_consensus.cc:1261] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Refusing update from remote peer 3cf2566db6364a1cb458ac1bc722dd36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.312472 24295 consensus_queue.cc:1035] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.312942 24295 consensus_queue.cc:1035] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.313158 24229 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: TxnStatusTablet state changed. Reason: New leader 3cf2566db6364a1cb458ac1bc722dd36. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.313282 24229 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.313759 24255 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: TxnStatusTablet state changed. Reason: New leader 3cf2566db6364a1cb458ac1bc722dd36. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.313868 24255 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.314682 24226 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.314764 24226 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:36.314890 24244 mvcc.cc:205] Tried to move back new op lower bound from 7315804226812473344 to 7315804226766577664. Current Snapshot: MvccSnapshot[applied={T|T < 7315804226812473344 or (T in {7315804226812473344})}]
I20260807 06:43:36.315146 24240 mvcc.cc:205] Tried to move back new op lower bound from 7315804226812473344 to 7315804226766577664. Current Snapshot: MvccSnapshot[applied={T|T < 7315804226812473344}]
I20260807 06:43:36.315224 24255 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.315310 24255 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 1db8850d6b3f4286ad07bb9813a62b24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.320405 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.317311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58682 (local address 127.11.137.129:34957)
0807 06:43:36.317356 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.317359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.317404 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:43:36.317494 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.317495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.317518 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.317587 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.317721 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.318465 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.319468 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.319768 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.319839 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.320045 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.320176 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.320250 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.320308 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.320329 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:36.321935 24295 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.322022 24295 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P 3cf2566db6364a1cb458ac1bc722dd36: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:43:36.322567 24229 tablet_replica.cc:439] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } } }
I20260807 06:43:36.322649 24229 tablet_replica.cc:442] T 3316cce08a7d4a43b2e5240b78afd931 P d4dbbd9a11c34eb59e577e40ba93d245: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:43:36.326663 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.324091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:34291 (local address 127.11.137.131:37417)
0807 06:43:36.324134 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.324136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.324203 (+ 67us) server_negotiation.cc:407] Connection header received
0807 06:43:36.324264 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.324265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.324274 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.324329 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.324504 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.325053 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.325923 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.326127 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.326225 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.326412 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.326452 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.326513 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.326573 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.326593 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 06:43:36.326694 24311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.323996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:37417 (local address 127.11.137.129:34291)
0807 06:43:36.324141 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.324152 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.324214 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.324333 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.324334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.324335 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:36.324404 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.324405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.325144 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.325145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.325829 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.325831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.326228 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.326230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.326301 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.326324 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.326515 (+ 191us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.326518 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.326560 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.326606 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":81,"threads_started":1}
I20260807 06:43:36.329161 24083 raft_consensus.cc:1261] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Refusing update from remote peer d4dbbd9a11c34eb59e577e40ba93d245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.329402 23844 raft_consensus.cc:1261] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Refusing update from remote peer d4dbbd9a11c34eb59e577e40ba93d245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.329484 24229 consensus_queue.cc:1035] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.330225 24229 consensus_queue.cc:1035] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.338722 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.335891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:45699 (local address 127.11.137.129:34957)
0807 06:43:36.336034 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.336035 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.336043 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:36.336063 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.336064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.336084 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.336128 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.336304 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.336807 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.337978 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.338307 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.338360 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.338544 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.338569 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.338605 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.338660 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.338675 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260807 06:43:36.338765 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.335852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:34957 (local address 127.11.137.131:45699)
0807 06:43:36.335917 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.335927 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.335962 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.336166 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.336166 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.336168 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:36.336228 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.336230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.336889 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.336890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.337856 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.337859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.338384 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.338384 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.338447 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.338463 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.338608 (+ 145us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.338609 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.338656 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.338693 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 06:43:36.348307 23347 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.348420 23347 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.349084 23347 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Sending DeleteTablet for 3 replicas of tablet f1e964e579664977abca6e3cc2a31b90
I20260807 06:43:36.349380 23589 tablet_service.cc:1514] Processing DeleteTablet for tablet f1e964e579664977abca6e3cc2a31b90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:58680
I20260807 06:43:36.349442 23821 tablet_service.cc:1514] Processing DeleteTablet for tablet f1e964e579664977abca6e3cc2a31b90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:44430
I20260807 06:43:36.349481 24268 tablet_replica.cc:330] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: stopping tablet replica
I20260807 06:43:36.349531 24268 raft_consensus.cc:2229] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:36.349542 24265 tablet_replica.cc:330] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: stopping tablet replica
I20260807 06:43:36.349598 24265 raft_consensus.cc:2229] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.349628 24265 raft_consensus.cc:2258] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.349628 24268 raft_consensus.cc:2258] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.349777 24050 tablet_service.cc:1514] Processing DeleteTablet for tablet f1e964e579664977abca6e3cc2a31b90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:33532
I20260807 06:43:36.349860 24266 tablet_replica.cc:330] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: stopping tablet replica
I20260807 06:43:36.349905 24266 raft_consensus.cc:2229] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.349946 24266 raft_consensus.cc:2258] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.349948 24268 ts_tablet_manager.cc:1905] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.349992 24265 ts_tablet_manager.cc:1905] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.350239 24266 ts_tablet_manager.cc:1905] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.351675 24268 ts_tablet_manager.cc:1918] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:36.351766 24268 log.cc:1196] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/f1e964e579664977abca6e3cc2a31b90
I20260807 06:43:36.352016 24268 ts_tablet_manager.cc:1939] T f1e964e579664977abca6e3cc2a31b90 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting consensus metadata
I20260807 06:43:36.352176 24266 ts_tablet_manager.cc:1918] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:36.352248 24266 log.cc:1196] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/f1e964e579664977abca6e3cc2a31b90
I20260807 06:43:36.352334 23331 catalog_manager.cc:4841] TS d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957): tablet f1e964e579664977abca6e3cc2a31b90 (table test-table [id=33271293f7934cc7a377473993907e2e]) successfully deleted
I20260807 06:43:36.352485 24266 ts_tablet_manager.cc:1939] T f1e964e579664977abca6e3cc2a31b90 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting consensus metadata
I20260807 06:43:36.352483 24265 ts_tablet_manager.cc:1918] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:36.352551 24265 log.cc:1196] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/f1e964e579664977abca6e3cc2a31b90
I20260807 06:43:36.352787 24265 ts_tablet_manager.cc:1939] T f1e964e579664977abca6e3cc2a31b90 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting consensus metadata
I20260807 06:43:36.352902 23330 catalog_manager.cc:4841] TS 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417): tablet f1e964e579664977abca6e3cc2a31b90 (table test-table [id=33271293f7934cc7a377473993907e2e]) successfully deleted
I20260807 06:43:36.353056 23333 catalog_manager.cc:4841] TS 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319): tablet f1e964e579664977abca6e3cc2a31b90 (table test-table [id=33271293f7934cc7a377473993907e2e]) successfully deleted
Aug 07 06:43:36 dist-test-slave-8hhm krb5kdc[23276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:43:36 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:36 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:43:36.379750 23433 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:36.373115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35644 (local address 127.11.137.190:46041)
0807 06:43:36.373195 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.373198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.373357 (+ 159us) server_negotiation.cc:407] Connection header received
0807 06:43:36.373444 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.373445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.373458 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.373525 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:36.374149 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.374811 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.375947 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.376257 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.376304 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.379674 (+ 3370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35644: BlockingRecv error: recv got EOF from 127.0.0.1:35644 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 06:43:36 dist-test-slave-8hhm krb5kdc[23276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM
I20260807 06:43:36.388121 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.380774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.11.137.190:46041)
0807 06:43:36.380818 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.380820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.380928 (+ 108us) server_negotiation.cc:407] Connection header received
0807 06:43:36.381003 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.381004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.381014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.381089 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:36.381605 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.382074 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.382761 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.382954 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.383030 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.385206 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:36.385207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:36.385226 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:36.385234 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:36.386979 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:36.387308 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:36.387309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:36.387309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:36.387369 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:36.387586 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:36.387586 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:36.387587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:36.387717 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:36.387824 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.387942 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.388020 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:36.389848 23347 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:36.390041 23347 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:36.391431 23589 tablet_service.cc:1467] Processing CreateTablet for tablet 3c277aad8f7f4947a11f9f5ecb6b0625 (DEFAULT_TABLE table=test-table [id=83f3565a47ad423994c184545fd79a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.391587 23589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c277aad8f7f4947a11f9f5ecb6b0625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.391563 23821 tablet_service.cc:1467] Processing CreateTablet for tablet 3c277aad8f7f4947a11f9f5ecb6b0625 (DEFAULT_TABLE table=test-table [id=83f3565a47ad423994c184545fd79a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.391674 23821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c277aad8f7f4947a11f9f5ecb6b0625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.393008 24050 tablet_service.cc:1467] Processing CreateTablet for tablet 3c277aad8f7f4947a11f9f5ecb6b0625 (DEFAULT_TABLE table=test-table [id=83f3565a47ad423994c184545fd79a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.393131 24050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c277aad8f7f4947a11f9f5ecb6b0625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.394124 24215 tablet_bootstrap.cc:492] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Bootstrap starting.
I20260807 06:43:36.394158 24220 tablet_bootstrap.cc:492] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Bootstrap starting.
I20260807 06:43:36.394510 24215 tablet_bootstrap.cc:654] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.394595 24220 tablet_bootstrap.cc:654] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.394963 24216 tablet_bootstrap.cc:492] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Bootstrap starting.
I20260807 06:43:36.395321 24216 tablet_bootstrap.cc:654] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.395437 24220 tablet_bootstrap.cc:492] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: No bootstrap required, opened a new log
I20260807 06:43:36.395481 24220 ts_tablet_manager.cc:1397] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:36.395646 24220 raft_consensus.cc:348] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.395730 24220 raft_consensus.cc:374] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.395754 24220 raft_consensus.cc:729] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4dbbd9a11c34eb59e577e40ba93d245, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.395804 24220 consensus_queue.cc:260] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.395905 24220 ts_tablet_manager.cc:1428] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:36.396162 24216 tablet_bootstrap.cc:492] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: No bootstrap required, opened a new log
I20260807 06:43:36.396211 24216 ts_tablet_manager.cc:1397] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:36.396319 24216 raft_consensus.cc:348] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.396389 24216 raft_consensus.cc:374] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.396412 24216 raft_consensus.cc:729] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db8850d6b3f4286ad07bb9813a62b24, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.396453 24216 consensus_queue.cc:260] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.396550 24216 ts_tablet_manager.cc:1428] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:36.397599 24215 tablet_bootstrap.cc:492] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: No bootstrap required, opened a new log
I20260807 06:43:36.397670 24215 ts_tablet_manager.cc:1397] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 06:43:36.397814 24215 raft_consensus.cc:348] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.397895 24215 raft_consensus.cc:374] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.397924 24215 raft_consensus.cc:729] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.397965 24215 consensus_queue.cc:260] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.398056 24215 ts_tablet_manager.cc:1428] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:36.592926 24318 raft_consensus.cc:482] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:36.593039 24318 raft_consensus.cc:504] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.593271 24318 leader_election.cc:288] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957), 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:36.593523 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c277aad8f7f4947a11f9f5ecb6b0625" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24" is_pre_election: true
I20260807 06:43:36.593523 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c277aad8f7f4947a11f9f5ecb6b0625" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" is_pre_election: true
I20260807 06:43:36.593647 23614 raft_consensus.cc:2454] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 0.
I20260807 06:43:36.593645 23844 raft_consensus.cc:2454] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 0.
I20260807 06:43:36.593827 23968 leader_election.cc:302] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.593950 24318 raft_consensus.cc:2781] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:36.594010 24318 raft_consensus.cc:482] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:36.594035 24318 raft_consensus.cc:3037] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.594767 24318 raft_consensus.cc:504] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.594911 24318 leader_election.cc:288] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 election: Requested vote from peers d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957), 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:36.595065 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c277aad8f7f4947a11f9f5ecb6b0625" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
I20260807 06:43:36.595155 23614 raft_consensus.cc:3037] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.595090 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c277aad8f7f4947a11f9f5ecb6b0625" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24"
I20260807 06:43:36.595192 23844 raft_consensus.cc:3037] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.595819 23614 raft_consensus.cc:2454] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 1.
I20260807 06:43:36.595853 23844 raft_consensus.cc:2454] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 1.
I20260807 06:43:36.596032 23968 leader_election.cc:302] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.596151 24318 raft_consensus.cc:2781] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:36.596240 24318 raft_consensus.cc:686] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 LEADER]: Becoming Leader. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Running, Role: LEADER
I20260807 06:43:36.596304 24318 consensus_queue.cc:237] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.596916 23347 catalog_manager.cc:5495] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:36.625734 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.623490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33538 (local address 127.11.137.131:37417)
0807 06:43:36.623570 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.623580 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.623588 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:36.623618 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.623619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.623628 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.623675 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.623807 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.624263 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.624993 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.625171 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.625262 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.625399 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.625425 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.625464 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.625610 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.625648 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:43:36.626675 23844 raft_consensus.cc:1261] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Refusing update from remote peer 3cf2566db6364a1cb458ac1bc722dd36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.626720 23614 raft_consensus.cc:1261] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Refusing update from remote peer 3cf2566db6364a1cb458ac1bc722dd36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.627036 24295 consensus_queue.cc:1035] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.627152 24318 consensus_queue.cc:1035] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.630249 23347 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.630350 23347 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.630995 23347 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Sending DeleteTablet for 3 replicas of tablet 3c277aad8f7f4947a11f9f5ecb6b0625
I20260807 06:43:36.631224 23821 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c277aad8f7f4947a11f9f5ecb6b0625 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:44430
I20260807 06:43:36.631235 24050 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c277aad8f7f4947a11f9f5ecb6b0625 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:33532
I20260807 06:43:36.631330 24265 tablet_replica.cc:330] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: stopping tablet replica
I20260807 06:43:36.631386 24265 raft_consensus.cc:2229] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.631422 24265 raft_consensus.cc:2258] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.631536 24266 tablet_replica.cc:330] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: stopping tablet replica
I20260807 06:43:36.631603 24266 raft_consensus.cc:2229] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:36.631690 24266 raft_consensus.cc:2258] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.632017 23347 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:43:36.632110 24265 ts_tablet_manager.cc:1905] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:43:36.632157 23347 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:36.633430 23821 tablet_service.cc:1467] Processing CreateTablet for tablet 91e7eb42e6cc441f807b5be927e6b74b (DEFAULT_TABLE table=test-table [id=f5eee2d841a243e3af3aa84a3171befe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.633618 24265 ts_tablet_manager.cc:1918] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:36.633620 23821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91e7eb42e6cc441f807b5be927e6b74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.633709 24265 log.cc:1196] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/3c277aad8f7f4947a11f9f5ecb6b0625
I20260807 06:43:36.633929 24265 ts_tablet_manager.cc:1939] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 1db8850d6b3f4286ad07bb9813a62b24: Deleting consensus metadata
I20260807 06:43:36.634395 24266 ts_tablet_manager.cc:1905] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.634913 24216 tablet_bootstrap.cc:492] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Bootstrap starting.
I20260807 06:43:36.635264 24216 tablet_bootstrap.cc:654] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.635842 24216 tablet_bootstrap.cc:492] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: No bootstrap required, opened a new log
I20260807 06:43:36.635842 24266 ts_tablet_manager.cc:1918] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:36.635908 24216 ts_tablet_manager.cc:1397] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:36.635931 24266 log.cc:1196] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/3c277aad8f7f4947a11f9f5ecb6b0625
I20260807 06:43:36.636008 24216 raft_consensus.cc:348] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.636078 24216 raft_consensus.cc:374] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.636124 24216 raft_consensus.cc:729] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db8850d6b3f4286ad07bb9813a62b24, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.636171 24266 ts_tablet_manager.cc:1939] T 3c277aad8f7f4947a11f9f5ecb6b0625 P 3cf2566db6364a1cb458ac1bc722dd36: Deleting consensus metadata
I20260807 06:43:36.636171 24216 consensus_queue.cc:260] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.636271 24216 ts_tablet_manager.cc:1428] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:36.636672 23589 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c277aad8f7f4947a11f9f5ecb6b0625 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:58680
I20260807 06:43:36.636729 23588 tablet_service.cc:1467] Processing CreateTablet for tablet 91e7eb42e6cc441f807b5be927e6b74b (DEFAULT_TABLE table=test-table [id=f5eee2d841a243e3af3aa84a3171befe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.636752 24050 tablet_service.cc:1467] Processing CreateTablet for tablet 91e7eb42e6cc441f807b5be927e6b74b (DEFAULT_TABLE table=test-table [id=f5eee2d841a243e3af3aa84a3171befe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:36.636839 24050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91e7eb42e6cc441f807b5be927e6b74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.636843 23588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91e7eb42e6cc441f807b5be927e6b74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:36.638001 24268 tablet_replica.cc:330] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: stopping tablet replica
I20260807 06:43:36.638064 24268 raft_consensus.cc:2229] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.638103 24268 raft_consensus.cc:2258] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.638181 24215 tablet_bootstrap.cc:492] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Bootstrap starting.
I20260807 06:43:36.638424 24220 tablet_bootstrap.cc:492] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245: Bootstrap starting.
I20260807 06:43:36.638512 24215 tablet_bootstrap.cc:654] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.638724 24220 tablet_bootstrap.cc:654] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:36.638778 23330 catalog_manager.cc:4841] TS 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417): tablet 3c277aad8f7f4947a11f9f5ecb6b0625 (table test-table [id=83f3565a47ad423994c184545fd79a63]) successfully deleted
I20260807 06:43:36.639091 24268 ts_tablet_manager.cc:1905] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.639585 24220 tablet_bootstrap.cc:492] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245: No bootstrap required, opened a new log
I20260807 06:43:36.639642 24220 ts_tablet_manager.cc:1397] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:43:36.639775 24220 raft_consensus.cc:348] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.639858 24220 raft_consensus.cc:374] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.639895 24220 raft_consensus.cc:729] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4dbbd9a11c34eb59e577e40ba93d245, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.639952 24220 consensus_queue.cc:260] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.640044 24220 ts_tablet_manager.cc:1428] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:36.640391 24268 ts_tablet_manager.cc:1918] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:36.640462 24268 log.cc:1196] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/3c277aad8f7f4947a11f9f5ecb6b0625
I20260807 06:43:36.640664 24268 ts_tablet_manager.cc:1939] T 3c277aad8f7f4947a11f9f5ecb6b0625 P d4dbbd9a11c34eb59e577e40ba93d245: Deleting consensus metadata
I20260807 06:43:36.641135 23331 catalog_manager.cc:4841] TS d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957): tablet 3c277aad8f7f4947a11f9f5ecb6b0625 (table test-table [id=83f3565a47ad423994c184545fd79a63]) successfully deleted
I20260807 06:43:36.641317 23333 catalog_manager.cc:4841] TS 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319): tablet 3c277aad8f7f4947a11f9f5ecb6b0625 (table test-table [id=83f3565a47ad423994c184545fd79a63]) successfully deleted
I20260807 06:43:36.641582 24215 tablet_bootstrap.cc:492] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: No bootstrap required, opened a new log
I20260807 06:43:36.641624 24215 ts_tablet_manager.cc:1397] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 06:43:36.641697 24215 raft_consensus.cc:348] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.641746 24215 raft_consensus.cc:374] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:36.641759 24215 raft_consensus.cc:729] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Initialized, Role: FOLLOWER
I20260807 06:43:36.641814 24215 consensus_queue.cc:260] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.641911 24215 ts_tablet_manager.cc:1428] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:36.838426 24226 raft_consensus.cc:482] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:36.838537 24226 raft_consensus.cc:504] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.838768 24226 leader_election.cc:288] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957), 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:36.839036 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e7eb42e6cc441f807b5be927e6b74b" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" is_pre_election: true
I20260807 06:43:36.839146 23614 raft_consensus.cc:2454] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 0.
I20260807 06:43:36.839056 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e7eb42e6cc441f807b5be927e6b74b" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24" is_pre_election: true
I20260807 06:43:36.839200 23844 raft_consensus.cc:2454] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 0.
I20260807 06:43:36.839371 23968 leader_election.cc:302] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.839516 24226 raft_consensus.cc:2781] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:36.839568 24226 raft_consensus.cc:482] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:36.839600 24226 raft_consensus.cc:3037] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.840400 24226 raft_consensus.cc:504] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.840579 24226 leader_election.cc:288] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 election: Requested vote from peers d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957), 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319)
I20260807 06:43:36.840791 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e7eb42e6cc441f807b5be927e6b74b" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4dbbd9a11c34eb59e577e40ba93d245"
I20260807 06:43:36.840795 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e7eb42e6cc441f807b5be927e6b74b" candidate_uuid: "3cf2566db6364a1cb458ac1bc722dd36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db8850d6b3f4286ad07bb9813a62b24"
I20260807 06:43:36.840891 23844 raft_consensus.cc:3037] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.840893 23614 raft_consensus.cc:3037] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:36.841566 23614 raft_consensus.cc:2454] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 1.
I20260807 06:43:36.841645 23844 raft_consensus.cc:2454] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf2566db6364a1cb458ac1bc722dd36 in term 1.
I20260807 06:43:36.841749 23968 leader_election.cc:302] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf2566db6364a1cb458ac1bc722dd36, d4dbbd9a11c34eb59e577e40ba93d245; no voters:
I20260807 06:43:36.841850 24226 raft_consensus.cc:2781] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:36.841902 24226 raft_consensus.cc:686] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 LEADER]: Becoming Leader. State: Replica: 3cf2566db6364a1cb458ac1bc722dd36, State: Running, Role: LEADER
I20260807 06:43:36.841965 24226 consensus_queue.cc:237] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } }
I20260807 06:43:36.842561 23355 catalog_manager.cc:5495] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "3cf2566db6364a1cb458ac1bc722dd36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cf2566db6364a1cb458ac1bc722dd36" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 37417 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:36.867144 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.865049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:44039 (local address 127.11.137.131:37417)
0807 06:43:36.865110 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:36.865112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:36.865160 (+ 48us) server_negotiation.cc:407] Connection header received
0807 06:43:36.865253 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:36.865254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:36.865265 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:36.865327 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:36.865432 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.865899 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.866585 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.866767 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.866824 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.866945 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.866969 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.867009 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:36.867060 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 06:43:36.867074 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:36.867213 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.864998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:37417 (local address 127.11.137.131:44039)
0807 06:43:36.865101 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.865111 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:36.865173 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:36.865340 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:36.865340 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:36.865341 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:43:36.865384 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.865386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.865964 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.865965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.866515 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:36.866517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:36.866844 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:36.866844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:36.866884 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:36.866888 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:43:36.867023 (+ 135us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:43:36.867025 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:36.867059 (+ 34us) client_negotiation.cc:240] Negotiation successful
0807 06:43:36.867097 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":59,"threads_started":1}
I20260807 06:43:36.869021 23844 raft_consensus.cc:1261] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Refusing update from remote peer 3cf2566db6364a1cb458ac1bc722dd36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.869091 23614 raft_consensus.cc:1261] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Refusing update from remote peer 3cf2566db6364a1cb458ac1bc722dd36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:36.869261 24295 consensus_queue.cc:1035] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db8850d6b3f4286ad07bb9813a62b24" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 42319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.869343 24318 consensus_queue.cc:1035] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4dbbd9a11c34eb59e577e40ba93d245" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:36.896914 23355 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.897068 23355 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:36.897832 23355 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 282ed086be47439b8401dc7585a12daf: Sending DeleteTablet for 3 replicas of tablet 91e7eb42e6cc441f807b5be927e6b74b
I20260807 06:43:36.898171 24050 tablet_service.cc:1514] Processing DeleteTablet for tablet 91e7eb42e6cc441f807b5be927e6b74b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:33532
I20260807 06:43:36.898191 23588 tablet_service.cc:1514] Processing DeleteTablet for tablet 91e7eb42e6cc441f807b5be927e6b74b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:58680
I20260807 06:43:36.898267 24266 tablet_replica.cc:330] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: stopping tablet replica
I20260807 06:43:36.898283 23821 tablet_service.cc:1514] Processing DeleteTablet for tablet 91e7eb42e6cc441f807b5be927e6b74b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:36 UTC) from {username='oryx', principal='oryx/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:44430
I20260807 06:43:36.898313 24266 raft_consensus.cc:2229] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:43:36.898372 24268 tablet_replica.cc:330] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245: stopping tablet replica
I20260807 06:43:36.898383 24266 raft_consensus.cc:2258] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.898419 24268 raft_consensus.cc:2229] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.898406 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 23473
I20260807 06:43:36.898458 24268 raft_consensus.cc:2258] T 91e7eb42e6cc441f807b5be927e6b74b P d4dbbd9a11c34eb59e577e40ba93d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.898523 24265 tablet_replica.cc:330] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: stopping tablet replica
I20260807 06:43:36.898576 24265 raft_consensus.cc:2229] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:36.898610 24265 raft_consensus.cc:2258] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:36.900154 24265 ts_tablet_manager.cc:1905] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.901599 24265 ts_tablet_manager.cc:1918] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:36.901650 24265 log.cc:1196] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/91e7eb42e6cc441f807b5be927e6b74b
I20260807 06:43:36.901834 24265 ts_tablet_manager.cc:1939] T 91e7eb42e6cc441f807b5be927e6b74b P 1db8850d6b3f4286ad07bb9813a62b24: Deleting consensus metadata
I20260807 06:43:36.903514 23333 catalog_manager.cc:4841] TS 1db8850d6b3f4286ad07bb9813a62b24 (127.11.137.130:42319): tablet 91e7eb42e6cc441f807b5be927e6b74b (table test-table [id=f5eee2d841a243e3af3aa84a3171befe]) successfully deleted
I20260807 06:43:36.903703 24266 ts_tablet_manager.cc:1905] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:36.904920 24266 ts_tablet_manager.cc:1918] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:43:36.904985 24266 log.cc:1196] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/91e7eb42e6cc441f807b5be927e6b74b
I20260807 06:43:36.905170 24266 ts_tablet_manager.cc:1939] T 91e7eb42e6cc441f807b5be927e6b74b P 3cf2566db6364a1cb458ac1bc722dd36: Deleting consensus metadata
I20260807 06:43:36.905524 23330 catalog_manager.cc:4841] TS 3cf2566db6364a1cb458ac1bc722dd36 (127.11.137.131:37417): tablet 91e7eb42e6cc441f807b5be927e6b74b (table test-table [id=f5eee2d841a243e3af3aa84a3171befe]) successfully deleted
W20260807 06:43:36.913120 23331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:34957 (error 108)
I20260807 06:43:36.913511 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 23712
I20260807 06:43:36.918192 24373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:36.913612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:34957 (local address 127.0.0.1:58698)
0807 06:43:36.918072 (+ 4460us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:36.918135 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:34957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4437,"thread_start_us":49,"threads_started":1}
W20260807 06:43:36.918306 23331 catalog_manager.cc:4584] TS d4dbbd9a11c34eb59e577e40ba93d245 (127.11.137.129:34957): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91e7eb42e6cc441f807b5be927e6b74b: Network error: Client connection negotiation failed: client connection to 127.11.137.129:34957: connect: Connection refused (error 111)
I20260807 06:43:36.927711 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 23937
I20260807 06:43:36.942387 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 23297
2026-08-07T06:43:36Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3095 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:37 dist-test-slave-8hhm krb5kdc[24378](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:37 dist-test-slave-8hhm krb5kdc[24378](info): set up 2 sockets
Aug 07 06:43:37 dist-test-slave-8hhm krb5kdc[24378](info): commencing operation
krb5kdc: starting...
W20260807 06:43:38.214660 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:38 dist-test-slave-8hhm krb5kdc[24378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:38.340001 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45515
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:36907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:45515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:38.423837 24408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:38.424070 24408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:38.424109 24408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:38.425343 24408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:38.425403 24408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:38.425426 24408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:38.425457 24408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:38.425486 24408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:38.426991 24408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:45515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:38.427268 24408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:38.427520 24408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:38.432451 24422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:38.432475 24417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:38.432472 24420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:38.432717 24408 server_base.cc:1034] running on GCE node
I20260807 06:43:38.432973 24408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:38.433346 24408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:38.434513 24408 hybrid_clock.cc:648] HybridClock initialized: now 1786085018434491 us; error 53 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T06:43:38Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1496 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:38 dist-test-slave-8hhm krb5kdc[24432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:38 dist-test-slave-8hhm krb5kdc[24432](info): set up 2 sockets
Aug 07 06:43:38 dist-test-slave-8hhm krb5kdc[24432](info): commencing operation
krb5kdc: starting...
W20260807 06:43:39.684806 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:39 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:39.804236 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36733
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:36733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:39.887852 24454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:39.888095 24454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:39.888134 24454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:39.889355 24454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:39.889416 24454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:39.889438 24454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:39.889459 24454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:39.889487 24454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:39.890967 24454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:36733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:39.891256 24454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:39.891487 24454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:39.896332 24461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:39.896332 24464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:39.896381 24460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:39.896694 24454 server_base.cc:1034] running on GCE node
I20260807 06:43:39.896937 24454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:39.897204 24454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:39.898427 24454 hybrid_clock.cc:648] HybridClock initialized: now 1786085019898407 us; error 25 us; skew 500 ppm
Aug 07 06:43:39 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085019, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:39.904573 24454 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:39.905031 24454 webserver.cc:460] Webserver started at http://127.11.137.190:43699/ using document root <none> and password file <none>
I20260807 06:43:39.905339 24454 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:39.905390 24454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:39.905556 24454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:39.906628 24454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "f6540bd7de004116b98116a720bba1cd"
format_stamp: "Formatted at 2026-08-07 06:43:39 on dist-test-slave-8hhm"
server_key: "9c0326b98365cb7363a5654291ed4d1b"
server_key_iv: "85a53af3f722d209d182c19c62956f3c"
server_key_version: "encryptionkey@0"
I20260807 06:43:39.907006 24454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "f6540bd7de004116b98116a720bba1cd"
format_stamp: "Formatted at 2026-08-07 06:43:39 on dist-test-slave-8hhm"
server_key: "9c0326b98365cb7363a5654291ed4d1b"
server_key_iv: "85a53af3f722d209d182c19c62956f3c"
server_key_version: "encryptionkey@0"
I20260807 06:43:39.908501 24454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:39.909353 24472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:39.909592 24454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:39.909715 24454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "f6540bd7de004116b98116a720bba1cd"
format_stamp: "Formatted at 2026-08-07 06:43:39 on dist-test-slave-8hhm"
server_key: "9c0326b98365cb7363a5654291ed4d1b"
server_key_iv: "85a53af3f722d209d182c19c62956f3c"
server_key_version: "encryptionkey@0"
I20260807 06:43:39.909806 24454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:39.930183 24454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:39.932184 24454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:39.932376 24454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:39.936582 24454 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:36733
I20260807 06:43:39.936609 24577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:36733 every 8 connection(s)
I20260807 06:43:39.937100 24454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:39.938136 24578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:39.939508 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 24454
I20260807 06:43:39.939636 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:39.939847 11814 external_mini_cluster.cc:1428] Setting key b6290c93a94fe159498f4f68bbc76731
I20260807 06:43:39.940898 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Bootstrap starting.
I20260807 06:43:39.941673 24578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:39.941998 24578 log.cc:824] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:39.942718 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: No bootstrap required, opened a new log
I20260807 06:43:39.944496 24578 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:39.944665 24578 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:39.944706 24578 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6540bd7de004116b98116a720bba1cd, State: Initialized, Role: FOLLOWER
I20260807 06:43:39.944834 24578 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:39.944924 24578 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:39.944972 24578 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:39.945043 24578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:39.945644 24578 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:39.945735 24578 leader_election.cc:302] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6540bd7de004116b98116a720bba1cd; no voters:
I20260807 06:43:39.945935 24578 leader_election.cc:288] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:39.945960 24585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:39.946089 24585 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 LEADER]: Becoming Leader. State: Replica: f6540bd7de004116b98116a720bba1cd, State: Running, Role: LEADER
I20260807 06:43:39.946183 24585 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:39.946224 24578 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:39.946497 24585 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6540bd7de004116b98116a720bba1cd. Latest consensus state: current_term: 1 leader_uuid: "f6540bd7de004116b98116a720bba1cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } } }
I20260807 06:43:39.946581 24585 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: This master's current role is: LEADER
Aug 07 06:43:39 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:39.946508 24587 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6540bd7de004116b98116a720bba1cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } } }
I20260807 06:43:39.946797 24595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:39.946802 24587 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:39.947338 24595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:39.949505 24595 catalog_manager.cc:1347] Generated new cluster ID: df0eab9a275d4895b8747e05d94f1615
I20260807 06:43:39.949576 24595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:39.951206 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:39.940412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52754 (local address 127.11.137.190:36733)
0807 06:43:39.940609 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:39.940619 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:39.940653 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:43:39.941193 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:39.941203 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:39.941315 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:39.941466 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:39.942146 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:39.943123 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:39.943885 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:39.944294 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:39.944422 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:39.947259 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:39.947264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:39.947264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:39.947277 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:39.949368 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:39.949786 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:39.949789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:39.949789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:39.949916 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:39.950137 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:39.950138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:39.950139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:39.950439 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:39.950561 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:39.950851 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 06:43:39.950992 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260807 06:43:39.997247 24595 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:39.997995 24595 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:40.004098 24595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Generated new TSK 0
I20260807 06:43:40.004304 24595 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:40.034386 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36733
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:40.116086 24623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:40.116340 24623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:40.116379 24623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:40.117583 24623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:40.117651 24623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:40.117703 24623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:40.119189 24623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:40.119469 24623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:40.119706 24623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:40.124799 24633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.124852 24623 server_base.cc:1034] running on GCE node
W20260807 06:43:40.124832 24636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.124832 24632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.125327 24623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:40.125612 24623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:40.126782 24623 hybrid_clock.cc:648] HybridClock initialized: now 1786085020126765 us; error 29 us; skew 500 ppm
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:40.129721 24623 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:40.130257 24623 webserver.cc:460] Webserver started at http://127.11.137.129:35115/ using document root <none> and password file <none>
I20260807 06:43:40.130528 24623 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:40.130596 24623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:40.130756 24623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:40.131850 24623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "dc276ac0b73d48648115f1a6b28530c1"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "40e7a9f7d39ff1f6eb5cc97288d22e63"
server_key_iv: "a63e645e42bb88536de042ccc3d67339"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.132249 24623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "dc276ac0b73d48648115f1a6b28530c1"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "40e7a9f7d39ff1f6eb5cc97288d22e63"
server_key_iv: "a63e645e42bb88536de042ccc3d67339"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.133723 24623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:40.134505 24651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.134689 24623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:40.134801 24623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "dc276ac0b73d48648115f1a6b28530c1"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "40e7a9f7d39ff1f6eb5cc97288d22e63"
server_key_iv: "a63e645e42bb88536de042ccc3d67339"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.134878 24623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:40.142649 24623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:40.144939 24623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:40.145109 24623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:40.145373 24623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:40.145732 24623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:40.145787 24623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.145830 24623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:40.145856 24623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.152459 24623 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:33163
I20260807 06:43:40.152511 24876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:33163 every 8 connection(s)
I20260807 06:43:40.152841 24623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:40.159976 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 24623
I20260807 06:43:40.160095 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:40.160317 11814 external_mini_cluster.cc:1428] Setting key 6acd83ddf9b5dbdcc176e358a2f80449
I20260807 06:43:40.162699 24881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.153607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:38005)
0807 06:43:40.153793 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:40.153827 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:40.154337 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:40.154605 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:40.154608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:40.155175 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:40.155368 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.155373 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.156122 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.156123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.156892 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.156894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.157363 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.157364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.157510 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.158017 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:40.158025 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:40.159375 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:40.161425 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:40.161431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:40.161433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:40.161655 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:40.161869 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:40.161870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:40.161870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:40.161956 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:40.162229 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:40.162235 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:40.162345 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 06:43:40.162428 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:43:40.162543 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260807 06:43:40.162734 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.153634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:38005 (local address 127.11.137.190:36733)
0807 06:43:40.153727 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:40.153729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:40.153913 (+ 184us) server_negotiation.cc:407] Connection header received
0807 06:43:40.154462 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:40.154463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:40.154476 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:40.154533 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:40.155483 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.156013 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.156989 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.157279 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.157341 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.159475 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:40.159477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:40.159477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:40.159485 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:40.161348 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:40.161736 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:40.161737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:40.161738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:40.161807 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:40.162014 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:40.162015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:40.162016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:40.162161 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:40.162233 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:40.162472 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 06:43:40.162578 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:43:40.163306 24877 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36733
I20260807 06:43:40.163434 24877 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:40.163614 24877 heartbeater.cc:511] Master 127.11.137.190:36733 requested a full tablet report, sending...
I20260807 06:43:40.164211 24502 ts_manager.cc:194] Registered new tserver with Master: dc276ac0b73d48648115f1a6b28530c1 (127.11.137.129:33163)
I20260807 06:43:40.165109 24502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:38005
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:40.186256 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36733
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:40.267917 24885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:40.268108 24885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:40.268132 24885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:40.269348 24885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:40.269390 24885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:40.269416 24885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:40.270756 24885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:40.270927 24885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:40.271086 24885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:40.276166 24896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.276147 24899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.276170 24895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.276214 24885 server_base.cc:1034] running on GCE node
I20260807 06:43:40.276629 24885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:40.276875 24885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:40.278012 24885 hybrid_clock.cc:648] HybridClock initialized: now 1786085020277998 us; error 28 us; skew 500 ppm
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:40.280525 24885 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:40.280949 24885 webserver.cc:460] Webserver started at http://127.11.137.130:40581/ using document root <none> and password file <none>
I20260807 06:43:40.281193 24885 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:40.281308 24885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:40.281466 24885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:40.282469 24885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "b774486f1d494f14aaca1584732c796b"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "c0100677553736a21bf52c81cff225e4"
server_key_iv: "9c4b6764fd7acad0615e10d608c760f1"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.282832 24885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "b774486f1d494f14aaca1584732c796b"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "c0100677553736a21bf52c81cff225e4"
server_key_iv: "9c4b6764fd7acad0615e10d608c760f1"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.284155 24885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:40.284842 24912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.285014 24885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:40.285130 24885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "b774486f1d494f14aaca1584732c796b"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "c0100677553736a21bf52c81cff225e4"
server_key_iv: "9c4b6764fd7acad0615e10d608c760f1"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.285236 24885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:40.294441 24885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:40.296115 24885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:40.296281 24885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:40.296510 24885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:40.296828 24885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:40.296880 24885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.296917 24885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:40.296947 24885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.302783 24885 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:33751
I20260807 06:43:40.302871 25129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:33751 every 8 connection(s)
I20260807 06:43:40.303143 24885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:40.310822 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 24885
I20260807 06:43:40.310940 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:40.311149 11814 external_mini_cluster.cc:1428] Setting key ea3a2c5d7f1d1c8831df06abe5d80fce
I20260807 06:43:40.312511 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.303966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:41381 (local address 127.11.137.190:36733)
0807 06:43:40.304057 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:40.304059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:40.304240 (+ 181us) server_negotiation.cc:407] Connection header received
0807 06:43:40.304686 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:40.304687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:40.304696 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:40.304752 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:40.305718 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.306212 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.307129 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.307309 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.307359 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.309423 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:40.309425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:40.309425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:40.309433 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:40.310841 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:40.311371 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:40.311373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:40.311373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:40.311445 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:40.311750 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:40.311751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:40.311752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:40.311926 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:40.311999 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:40.312352 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 06:43:40.312423 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:43:40.312793 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.303935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:41381)
0807 06:43:40.304099 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:40.304140 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:40.304606 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:40.304802 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:40.304805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:40.305451 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:40.305631 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.305637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.306294 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.306294 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.307051 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.307053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.307380 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.307381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.307476 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.307906 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:40.307913 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:40.309330 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:40.310959 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:40.310967 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:40.310969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:40.311276 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:40.311517 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:40.311518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:40.311518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:40.311644 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:40.312007 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:40.312015 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:40.312185 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 06:43:40.312329 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 06:43:40.312503 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260807 06:43:40.313347 25132 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36733
I20260807 06:43:40.313452 25132 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:40.313653 25132 heartbeater.cc:511] Master 127.11.137.190:36733 requested a full tablet report, sending...
I20260807 06:43:40.314062 24502 ts_manager.cc:194] Registered new tserver with Master: b774486f1d494f14aaca1584732c796b (127.11.137.130:33751)
I20260807 06:43:40.314443 24502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:41381
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:40.337388 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36733
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:40.418496 25140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:40.418700 25140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:40.418742 25140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:40.419857 25140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:40.419890 25140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:40.419914 25140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:40.421281 25140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:40.421455 25140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:40.421620 25140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:40.426752 25154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.426779 25156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.426785 25151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.426999 25140 server_base.cc:1034] running on GCE node
I20260807 06:43:40.427255 25140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:40.427518 25140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:40.428663 25140 hybrid_clock.cc:648] HybridClock initialized: now 1786085020428661 us; error 40 us; skew 500 ppm
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:40.431530 25140 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:40.432004 25140 webserver.cc:460] Webserver started at http://127.11.137.131:38165/ using document root <none> and password file <none>
I20260807 06:43:40.432271 25140 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:40.432340 25140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:40.432478 25140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:40.433652 25140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "d9ab7c5db7654d11af7669bc0019ffea"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "4fa32f1ce2e18241153036accc6d515e"
server_key_iv: "a3eec8c7ae020aac58401f1e0e4a1338"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.434037 25140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "d9ab7c5db7654d11af7669bc0019ffea"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "4fa32f1ce2e18241153036accc6d515e"
server_key_iv: "a3eec8c7ae020aac58401f1e0e4a1338"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.435400 25140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:40.436146 25164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.436324 25140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:40.436427 25140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "d9ab7c5db7654d11af7669bc0019ffea"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "4fa32f1ce2e18241153036accc6d515e"
server_key_iv: "a3eec8c7ae020aac58401f1e0e4a1338"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.436510 25140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:40.456202 25140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:40.458307 25140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:40.458470 25140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:40.458724 25140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:40.459081 25140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:40.459136 25140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.459187 25140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:40.459218 25140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.465190 25140 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:38059
I20260807 06:43:40.465312 25373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:38059 every 8 connection(s)
I20260807 06:43:40.465626 25140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:40.472780 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 25140
I20260807 06:43:40.472885 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:40.473078 11814 external_mini_cluster.cc:1428] Setting key 65890536c8cba86b3f1a1c86e6477b74
I20260807 06:43:40.475383 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.466412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:41473 (local address 127.11.137.190:36733)
0807 06:43:40.466459 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:40.466461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:40.466651 (+ 190us) server_negotiation.cc:407] Connection header received
0807 06:43:40.467194 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:40.467196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:40.467210 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:40.467267 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:40.468236 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.468786 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.469856 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.470054 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.470137 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.472284 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:40.472286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:40.472286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:40.472294 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:40.473896 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:40.474337 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:40.474338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:40.474339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:40.474407 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:40.474709 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:40.474710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:40.474710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:40.474832 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:40.474906 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:40.475204 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 06:43:40.475290 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:40.475594 25379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.466364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:41473)
0807 06:43:40.466512 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:40.466561 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:40.467079 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:40.467336 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:40.467340 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:40.467931 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:40.468126 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.468131 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.468881 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.468882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.469762 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.469764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.470151 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.470152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.470282 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.470748 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:40.470756 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:40.472194 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:40.474007 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:40.474015 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:40.474017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:40.474252 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:40.474485 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:40.474486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:40.474486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:40.474630 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:40.474910 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:40.474917 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:40.475061 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 06:43:40.475181 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 06:43:40.475344 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
I20260807 06:43:40.476054 25374 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36733
I20260807 06:43:40.476151 25374 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:40.476310 25374 heartbeater.cc:511] Master 127.11.137.190:36733 requested a full tablet report, sending...
I20260807 06:43:40.476667 24502 ts_manager.cc:194] Registered new tserver with Master: d9ab7c5db7654d11af7669bc0019ffea (127.11.137.131:38059)
I20260807 06:43:40.476987 24502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:41473
I20260807 06:43:40.485116 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab.
Entry for principal oryx/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab.
WARNING: no policy specified for oryx/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab.
Entry for principal oryx/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab.
WARNING: no policy specified for oryx/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab.
Entry for principal oryx/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab.
I20260807 06:43:40.555696 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 24623
I20260807 06:43:40.582446 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 24885
I20260807 06:43:40.595830 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 25140
I20260807 06:43:40.605651 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 24454
I20260807 06:43:40.615154 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36733
--webserver_interface=127.11.137.190
--webserver_port=43699
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:36733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:40.697283 25396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:40.697530 25396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:40.697568 25396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:40.698938 25396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:40.699033 25396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:40.699059 25396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:40.699088 25396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:40.699118 25396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:40.700742 25396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:36733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=43699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:40.701030 25396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:40.701287 25396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:40.706187 25403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.706192 25407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.706220 25404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.706481 25396 server_base.cc:1034] running on GCE node
I20260807 06:43:40.706745 25396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:40.707047 25396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:40.708225 25396 hybrid_clock.cc:648] HybridClock initialized: now 1786085020708202 us; error 38 us; skew 500 ppm
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:40.710795 25396 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:40.711295 25396 webserver.cc:460] Webserver started at http://127.11.137.190:43699/ using document root <none> and password file <none>
I20260807 06:43:40.711519 25396 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:40.711602 25396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:40.713047 25396 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:40.713793 25418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.713969 25396 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.714098 25396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "f6540bd7de004116b98116a720bba1cd"
format_stamp: "Formatted at 2026-08-07 06:43:39 on dist-test-slave-8hhm"
server_key: "9c0326b98365cb7363a5654291ed4d1b"
server_key_iv: "85a53af3f722d209d182c19c62956f3c"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.714459 25396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:40.735281 25396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:40.737085 25396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:40.737293 25396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:40.741596 25396 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:36733
I20260807 06:43:40.741633 25514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:36733 every 8 connection(s)
I20260807 06:43:40.742007 25396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:40.743439 25516 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:43:40.744040 25516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Bootstrap starting.
I20260807 06:43:40.750804 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 25396
I20260807 06:43:40.751170 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:33163
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:36733
--webserver_port=35115
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:43:40.753880 25516 log.cc:824] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:40.755659 25516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:43:40.755947 25516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Bootstrap complete.
I20260807 06:43:40.758366 25516 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:40.758584 25516 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6540bd7de004116b98116a720bba1cd, State: Initialized, Role: FOLLOWER
I20260807 06:43:40.758746 25516 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:40.758836 25516 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:40.758942 25516 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:40.758996 25516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:43:40.760107 25516 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:40.760234 25516 leader_election.cc:302] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6540bd7de004116b98116a720bba1cd; no voters:
I20260807 06:43:40.760440 25516 leader_election.cc:288] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:43:40.760473 25529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:43:40.760599 25529 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [term 2 LEADER]: Becoming Leader. State: Replica: f6540bd7de004116b98116a720bba1cd, State: Running, Role: LEADER
I20260807 06:43:40.760725 25516 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:40.760756 25529 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } }
I20260807 06:43:40.761133 25530 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f6540bd7de004116b98116a720bba1cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } } }
I20260807 06:43:40.761234 25530 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:40.761566 25534 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6540bd7de004116b98116a720bba1cd. Latest consensus state: current_term: 2 leader_uuid: "f6540bd7de004116b98116a720bba1cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6540bd7de004116b98116a720bba1cd" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36733 } } }
I20260807 06:43:40.761636 25534 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:40.761768 25542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:40.762313 25542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:40.762522 25542 catalog_manager.cc:1259] Loaded cluster ID: df0eab9a275d4895b8747e05d94f1615
I20260807 06:43:40.762737 25542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:40.763895 25542 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:40.764074 25542 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f6540bd7de004116b98116a720bba1cd: Loaded TSK: 0
I20260807 06:43:40.764289 25542 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:43:40.836407 25523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:40.836640 25523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:40.836683 25523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:40.837899 25523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:40.837966 25523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:40.838008 25523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:40.839576 25523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.129.keytab
--principal=oryx/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:33163
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=35115
--tserver_master_addrs=127.11.137.190:36733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:40.839840 25523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:40.840075 25523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:40.846128 25573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.846100 25577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.846141 25572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.846386 25523 server_base.cc:1034] running on GCE node
I20260807 06:43:40.846640 25523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:40.846901 25523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:40.848091 25523 hybrid_clock.cc:648] HybridClock initialized: now 1786085020848084 us; error 39 us; skew 500 ppm
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:40.850670 25523 init.cc:377] Logged in from keytab as oryx/127.11.137.129@KRBTEST.COM (short username oryx)
I20260807 06:43:40.851155 25523 webserver.cc:460] Webserver started at http://127.11.137.129:35115/ using document root <none> and password file <none>
I20260807 06:43:40.851398 25523 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:40.851457 25523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:40.852886 25523 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:40.853617 25587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.853781 25523 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:40.853888 25523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "dc276ac0b73d48648115f1a6b28530c1"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "40e7a9f7d39ff1f6eb5cc97288d22e63"
server_key_iv: "a63e645e42bb88536de042ccc3d67339"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.854241 25523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:40.875372 25523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:40.877758 25523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:40.877903 25523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:40.878137 25523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:40.878525 25523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:40.878578 25523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.878621 25523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:40.878646 25523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.885905 25523 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:33163
I20260807 06:43:40.886382 25523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:40.886533 25773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:33163 every 8 connection(s)
I20260807 06:43:40.887710 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 25523
I20260807 06:43:40.888039 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:33751
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:36733
--webserver_port=40581
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:40.897398 25778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.887277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:57981)
0807 06:43:40.887538 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:40.887578 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:40.888237 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:40.889071 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:40.889075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:40.890077 (+ 1002us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:40.890384 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.890391 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.891935 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.891936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.893369 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.893374 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.893945 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.893947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.894102 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.894659 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:40.894670 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:40.897192 (+ 2522us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":87,"threads_started":1}
W20260807 06:43:40.897596 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:40.887368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:57981 (local address 127.11.137.190:36733)
0807 06:43:40.888593 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:40.888602 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:40.888659 (+ 57us) server_negotiation.cc:407] Connection header received
0807 06:43:40.888796 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:40.888802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:40.888858 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:40.889030 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:40.890532 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.891817 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.893467 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.893850 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.893931 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.897382 (+ 3451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:57981: BlockingRecv error: recv got EOF from 127.11.137.129:57981 (error 108)
Metrics: {"server-negotiator.queue_time_us":1138,"thread_start_us":115,"threads_started":1}
W20260807 06:43:40.897626 25775 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:36733 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.137.190:36733: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:40.902915 25778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.897862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:60519)
0807 06:43:40.897973 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:40.897983 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:40.898029 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:40.898158 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:40.898159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:40.898277 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:40.898318 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.898319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.899240 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.899241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.900119 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.900122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.900640 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.900641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.900703 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.901133 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:40.901138 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:40.902870 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96}
W20260807 06:43:40.903254 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:40.897925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:60519 (local address 127.11.137.190:36733)
0807 06:43:40.897990 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:40.897992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:40.898019 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:43:40.898071 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:40.898072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:40.898087 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:40.898159 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:40.898384 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.899154 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.900211 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.900558 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.900636 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.902964 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:60519: BlockingRecv error: recv got EOF from 127.11.137.129:60519 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:40.907603 25778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:40.903162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:35519)
0807 06:43:40.903195 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:40.903205 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:40.903266 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:40.903449 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:40.903450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:40.903600 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:40.903630 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.903631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.904196 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.904197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.904997 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:40.905000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.905364 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.905365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:40.905420 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.905796 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:40.905801 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:40.907520 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":20}
W20260807 06:43:40.907621 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:40.903274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:35519 (local address 127.11.137.190:36733)
0807 06:43:40.903323 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:40.903324 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:40.903331 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:40.903350 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:40.903351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:40.903361 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:40.903411 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:40.903705 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.904123 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.905076 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:40.905302 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:40.905353 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:40.907579 (+ 2226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:35519: BlockingRecv error: recv got EOF from 127.11.137.129:35519 (error 108)
Metrics: {"server-negotiator.queue_time_us":34,"thread_start_us":131,"threads_started":1}
W20260807 06:43:40.907944 25775 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:43:40.979848 25782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:40.980093 25782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:40.980129 25782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:40.981336 25782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:40.981391 25782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:40.981434 25782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:40.982836 25782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.130.keytab
--principal=oryx/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:33751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=40581
--tserver_master_addrs=127.11.137.190:36733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:40.983080 25782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:40.983349 25782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:40.988565 25803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.988533 25800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:40.988539 25798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:40.988782 25782 server_base.cc:1034] running on GCE node
I20260807 06:43:40.988979 25782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:40.989266 25782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:40.990422 25782 hybrid_clock.cc:648] HybridClock initialized: now 1786085020990423 us; error 37 us; skew 500 ppm
Aug 07 06:43:40 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085020, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:40.992897 25782 init.cc:377] Logged in from keytab as oryx/127.11.137.130@KRBTEST.COM (short username oryx)
I20260807 06:43:40.993463 25782 webserver.cc:460] Webserver started at http://127.11.137.130:40581/ using document root <none> and password file <none>
I20260807 06:43:40.993705 25782 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:40.993788 25782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:40.995174 25782 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:40.995802 25818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:40.995986 25782 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:40.996098 25782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "b774486f1d494f14aaca1584732c796b"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "c0100677553736a21bf52c81cff225e4"
server_key_iv: "9c4b6764fd7acad0615e10d608c760f1"
server_key_version: "encryptionkey@0"
I20260807 06:43:40.996454 25782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:41.018573 25782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:41.020646 25782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:41.020819 25782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:41.021134 25782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:41.021490 25782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:41.021549 25782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:41.021602 25782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:41.021633 25782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:41.028420 25782 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:33751
I20260807 06:43:41.028463 26013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:33751 every 8 connection(s)
I20260807 06:43:41.028807 25782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.035099 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 25782
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.035458 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:38059
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:36733
--webserver_port=38165
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:41.036254 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.029535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:50353 (local address 127.11.137.190:36733)
0807 06:43:41.029603 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.029605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.029813 (+ 208us) server_negotiation.cc:407] Connection header received
0807 06:43:41.030280 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.030282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.030316 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.030379 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.031315 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.031817 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.032760 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.032944 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.032998 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.036197 (+ 3199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:50353: BlockingRecv error: recv got EOF from 127.11.137.130:50353 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:43:41.036331 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.029541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:50353)
0807 06:43:41.029688 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.029726 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.030200 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.030468 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.030471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.031050 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.031242 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.031247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.031897 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.031897 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.032674 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.032676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.033020 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.033021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.033123 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.033697 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.033705 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.036118 (+ 2413us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
W20260807 06:43:41.036537 26014 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:36733 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.137.190:36733: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.041262 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.036784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:60285)
0807 06:43:41.036826 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.036834 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.036870 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.037002 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.037003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.037139 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.037181 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.037183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.037820 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.037821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.038322 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.038323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.038693 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.038694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.038758 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.039269 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.039274 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.041151 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 06:43:41.041301 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.036840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:60285 (local address 127.11.137.190:36733)
0807 06:43:41.036904 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.036906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.036913 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:41.036933 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.036933 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.036941 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.036994 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.037289 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.037737 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.038405 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.038605 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.038695 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.041239 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:60285: BlockingRecv error: recv got EOF from 127.11.137.130:60285 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.045658 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.041588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:52417)
0807 06:43:41.041627 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.041643 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.041674 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.041869 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.041870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.041994 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.042018 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.042019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.042661 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.042662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.043145 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.043147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.043491 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.043492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.043544 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.043984 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.043988 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.045580 (+ 1592us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 06:43:41.045769 26014 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:43:41.045709 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.041678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:52417 (local address 127.11.137.190:36733)
0807 06:43:41.041759 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.041761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.041775 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:43:41.041793 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.041793 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.041800 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.041864 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.042133 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.042582 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.043231 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.043418 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.043492 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.045648 (+ 2156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:52417: BlockingRecv error: recv got EOF from 127.11.137.130:52417 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 06:43:41.120430 26020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:41.120628 26020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:41.120651 26020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:41.121928 26020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:41.121971 26020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:41.121996 26020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:41.123414 26020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/krb5kdc/oryx_127.11.137.131.keytab
--principal=oryx/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:38059
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=38165
--tserver_master_addrs=127.11.137.190:36733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:41.123646 26020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:41.123878 26020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:41.129204 26029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:41.129246 26030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:41.129204 26033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:41.129513 26020 server_base.cc:1034] running on GCE node
I20260807 06:43:41.129781 26020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:41.130044 26020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:41.131232 26020 hybrid_clock.cc:648] HybridClock initialized: now 1786085021131196 us; error 40 us; skew 500 ppm
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085021, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:41.133791 26020 init.cc:377] Logged in from keytab as oryx/127.11.137.131@KRBTEST.COM (short username oryx)
I20260807 06:43:41.134248 26020 webserver.cc:460] Webserver started at http://127.11.137.131:38165/ using document root <none> and password file <none>
I20260807 06:43:41.134434 26020 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:41.134487 26020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:41.135797 26020 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:41.136322 26046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:41.136489 26020 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:41.136608 26020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "d9ab7c5db7654d11af7669bc0019ffea"
format_stamp: "Formatted at 2026-08-07 06:43:40 on dist-test-slave-8hhm"
server_key: "4fa32f1ce2e18241153036accc6d515e"
server_key_iv: "a3eec8c7ae020aac58401f1e0e4a1338"
server_key_version: "encryptionkey@0"
I20260807 06:43:41.136960 26020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:41.145862 26020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:41.147634 26020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:41.147794 26020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:41.148028 26020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:41.148339 26020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:41.148392 26020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:41.148433 26020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:41.148461 26020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:41.154342 26020 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:38059
I20260807 06:43:41.154382 26239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:38059 every 8 connection(s)
I20260807 06:43:41.154748 26020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.161605 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 26020
W20260807 06:43:41.162132 25780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.155508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:42539 (local address 127.11.137.190:36733)
0807 06:43:41.155558 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.155561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.155751 (+ 190us) server_negotiation.cc:407] Connection header received
0807 06:43:41.156307 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.156308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.156319 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.156375 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.157328 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.157877 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.158803 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.158982 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.159032 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.162048 (+ 3016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:42539: BlockingRecv error: recv got EOF from 127.11.137.131:42539 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:43:41.162171 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.155465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:42539)
0807 06:43:41.155616 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.155659 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.156175 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.156436 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.156439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.157020 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.157237 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.157241 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.157958 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.157959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.158725 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.158727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.159055 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.159056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.159157 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.159597 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.159605 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.161979 (+ 2374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
W20260807 06:43:41.162351 26240 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:36733 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.137.190:36733: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.166985 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.162570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:43295)
0807 06:43:41.162635 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.162646 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.162686 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.162838 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.162839 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.162950 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.162990 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.162992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.163680 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.163681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.164200 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.164201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.164626 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.164627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.164697 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.165130 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.165136 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.166908 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 06:43:41.167047 25784 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.162622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:43295 (local address 127.11.137.190:36733)
0807 06:43:41.162678 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.162680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.162690 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:41.162741 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.162742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.162754 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.162830 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.163068 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.163601 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.164279 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.164551 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.164602 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.166979 (+ 2377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:43295: BlockingRecv error: recv got EOF from 127.11.137.131:43295 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:43:41.169533 25780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.162203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.11.137.190:36733)
0807 06:43:41.162335 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.162337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.162347 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:41.162370 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.162370 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.162380 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.162446 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.163208 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.163672 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.164428 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.164637 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.164700 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.166063 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:41.166068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:41.166068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:41.166079 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:41.168018 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:41.168401 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:41.168404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:41.168404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:41.168528 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:41.168757 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:41.168757 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:41.168758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:41.168974 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:41.169116 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:41.169280 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 06:43:41.169436 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.171394 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.167408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:52761)
0807 06:43:41.167468 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.167479 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.167533 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.167642 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.167642 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.167780 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.167813 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.167814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.168392 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.168393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.168879 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.168881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.169296 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.169297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.169355 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.169718 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.169724 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.171319 (+ 1595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 06:43:41.171444 25784 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.167460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:52761 (local address 127.11.137.190:36733)
0807 06:43:41.167491 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.167493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.167525 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:43:41.167588 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.167588 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.167595 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.167637 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.167881 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.168300 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.168963 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.169169 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.169282 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.171388 (+ 2106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:52761: BlockingRecv error: recv got EOF from 127.11.137.131:52761 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 06:43:41.171542 26240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:41 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:41.913618 26247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:41.908527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:43985)
0807 06:43:41.908724 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:41.908737 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:41.908809 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:41.909014 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:41.909015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:41.909225 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:41.909303 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.909306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.910086 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.910087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.910641 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:41.910643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.911033 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.911034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:41.911096 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.911600 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:41.911608 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:41.913506 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":92,"threads_started":1}
W20260807 06:43:41.913661 26249 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:41.908605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:43985 (local address 127.11.137.190:36733)
0807 06:43:41.908795 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:41.908798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:41.908810 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:41.908880 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:41.908880 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:41.908892 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:41.908992 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:41.909391 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.910002 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.910736 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:41.910942 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:41.911030 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:41.913587 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:43985: BlockingRecv error: recv got EOF from 127.11.137.129:43985 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":110,"threads_started":1}
Aug 07 06:43:42 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:42 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:42.051191 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:42.046184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:33559)
0807 06:43:42.046361 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:42.046372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:42.046452 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:42.046636 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:42.046637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:42.046812 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:42.046858 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:42.046860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.047504 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.047506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:42.048039 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:42.048041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.048396 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.048397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:42.048454 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:42.049003 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:42.049007 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:42.051083 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":89,"threads_started":1}
W20260807 06:43:42.051226 26249 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:42.046242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:33559 (local address 127.11.137.190:36733)
0807 06:43:42.046313 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:42.046315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:42.046434 (+ 119us) server_negotiation.cc:407] Connection header received
0807 06:43:42.046529 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:42.046530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:42.046549 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:42.046606 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:42.046939 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.047421 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.048135 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.048325 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.048396 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:42.051159 (+ 2763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:33559: BlockingRecv error: recv got EOF from 127.11.137.130:33559 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 06:43:42 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:42 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:42.176457 26252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:42.171877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:33197)
0807 06:43:42.172033 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:42.172046 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:42.172135 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:42.172285 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:42.172286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:42.172468 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:42.172516 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:42.172519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.173246 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.173247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:42.173782 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:42.173784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.174156 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.174156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:42.174222 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:42.174619 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:42.174623 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:42.176389 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
W20260807 06:43:42.176589 26249 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:42.171958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:33197 (local address 127.11.137.190:36733)
0807 06:43:42.172037 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:42.172039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:42.172117 (+ 78us) server_negotiation.cc:407] Connection header received
0807 06:43:42.172218 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:42.172219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:42.172233 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:42.172278 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:42.172620 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.173128 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.173872 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.174080 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.174156 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:42.176488 (+ 2332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:33197: BlockingRecv error: recv got EOF from 127.11.137.131:33197 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 06:43:42 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:42 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:42.918895 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:42.914115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:33779)
0807 06:43:42.914273 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:42.914284 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:42.914347 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:42.914476 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:42.914477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:42.914643 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:42.914695 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:42.914696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.915323 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.915324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:42.915855 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:42.915857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.916243 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.916245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:42.916318 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:42.916924 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:42.916929 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:42.918827 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
W20260807 06:43:42.919016 26256 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:42.914191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:33779 (local address 127.11.137.190:36733)
0807 06:43:42.914292 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:42.914294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:42.914342 (+ 48us) server_negotiation.cc:407] Connection header received
0807 06:43:42.914389 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:42.914389 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:42.914400 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:42.914459 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:42.914757 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.915233 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.915925 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:42.916111 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:42.916195 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:42.918916 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:33779: BlockingRecv error: recv got EOF from 127.11.137.129:33779 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":50,"threads_started":1}
Aug 07 06:43:43 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:43 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:43.056631 26260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:43.051750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:39021)
0807 06:43:43.051925 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:43.051936 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:43.052009 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:43.052228 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:43.052229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:43.052390 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:43.052440 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:43.052442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.053066 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.053067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:43.053661 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:43.053663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.053990 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.053992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:43.054034 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:43.054533 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:43.054543 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:43.056518 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
W20260807 06:43:43.056691 26256 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:43.051793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:39021 (local address 127.11.137.190:36733)
0807 06:43:43.051855 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:43.051857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:43.052012 (+ 155us) server_negotiation.cc:407] Connection header received
0807 06:43:43.052115 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:43.052116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:43.052138 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:43.052185 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:43.052511 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.053003 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.053736 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.053924 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.053979 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:43.056609 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:39021: BlockingRecv error: recv got EOF from 127.11.137.130:39021 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 07 06:43:43 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:43 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:43.181419 26263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:43.176947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:34483)
0807 06:43:43.177134 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:43.177144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:43.177194 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:43.177354 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:43.177354 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:43.177523 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:43.177574 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:43.177575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.178179 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.178180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:43.178676 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:43.178677 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.179043 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.179044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:43.179085 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:43.179591 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:43.179596 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:43.181328 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":122,"threads_started":1}
W20260807 06:43:43.181488 26256 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:43.177114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:34483 (local address 127.11.137.190:36733)
0807 06:43:43.177187 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:43.177189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:43.177198 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:43.177273 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:43.177273 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:43.177286 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:43.177333 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:43.177639 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.178108 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.178770 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.178975 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.179032 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:43.181421 (+ 2389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:34483: BlockingRecv error: recv got EOF from 127.11.137.131:34483 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 06:43:43 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:43 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:43.924371 26265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:43.919376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:57191)
0807 06:43:43.919519 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:43.919534 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:43.919599 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:43.919776 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:43.919777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:43.919964 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:43.920015 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:43.920016 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.920717 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.920719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:43.921308 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:43.921310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.921729 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.921730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:43.921790 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:43.922367 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:43.922373 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:43.924309 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
W20260807 06:43:43.924475 26266 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:43.919424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:57191 (local address 127.11.137.190:36733)
0807 06:43:43.919564 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:43.919566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:43.919578 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:43.919682 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:43.919683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:43.919696 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:43.919761 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:43.920100 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.920623 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.921403 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:43.921648 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:43.921727 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:43.924399 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:57191: BlockingRecv error: recv got EOF from 127.11.137.129:57191 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
Aug 07 06:43:44 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:44 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:44.061940 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:44.057187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:49635)
0807 06:43:44.057356 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:44.057367 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:44.057437 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:44.057574 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:44.057575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:44.057749 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:44.057801 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:44.057802 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.058463 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.058464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:44.058984 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:44.058986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.059338 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.059339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:44.059378 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:44.059896 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:44.059900 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:44.061879 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":115,"threads_started":1}
W20260807 06:43:44.062120 26266 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:44.057291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49635 (local address 127.11.137.190:36733)
0807 06:43:44.057359 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:44.057362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:44.057441 (+ 79us) server_negotiation.cc:407] Connection header received
0807 06:43:44.057486 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:44.057486 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:44.057497 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:44.057556 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:44.057864 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.058392 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.059063 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.059271 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.059325 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:44.061996 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:49635: BlockingRecv error: recv got EOF from 127.11.137.130:49635 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 07 06:43:44 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:44 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:44.187399 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:44.182098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:49725)
0807 06:43:44.182295 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:44.182310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:44.182384 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:44.182537 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:44.182538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:44.182741 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:44.182798 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:44.182800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.183707 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.183708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:44.184258 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:44.184260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.184600 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.184602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:44.184655 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:44.185477 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:44.185483 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:44.187322 (+ 1839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":143,"threads_started":1}
W20260807 06:43:44.187480 26266 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:44.182192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49725 (local address 127.11.137.190:36733)
0807 06:43:44.182275 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:44.182277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:44.182384 (+ 107us) server_negotiation.cc:407] Connection header received
0807 06:43:44.182435 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:44.182435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:44.182447 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:44.182505 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:44.182861 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.183633 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.184336 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.184511 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.184560 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:44.187431 (+ 2871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:49725: BlockingRecv error: recv got EOF from 127.11.137.131:49725 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 06:43:44 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:44 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:44.933936 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:44.924933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:38035)
0807 06:43:44.925120 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:44.925132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:44.925191 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:44.925380 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:44.925381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:44.925569 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:44.925623 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:44.925625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.926286 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.926287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:44.926847 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:44.926849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.927216 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.927217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:44.927259 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:44.931776 (+ 4517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:44.931781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:44.933832 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":92,"threads_started":1}
W20260807 06:43:44.933996 26271 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:44.925039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:38035 (local address 127.11.137.190:36733)
0807 06:43:44.925241 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:44.925243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:44.925254 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:43:44.925285 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:44.925286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:44.925296 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:44.925357 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:44.925696 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.926177 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.926947 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:44.927148 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:44.927204 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:44.933922 (+ 6718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:38035: BlockingRecv error: recv got EOF from 127.11.137.129:38035 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":108,"threads_started":1}
Aug 07 06:43:45 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:45 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:45.067440 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:45.062515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:49349)
0807 06:43:45.062666 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:45.062678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:45.062744 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:45.062907 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:45.062908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:45.063126 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:45.063188 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:45.063191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.063903 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.063904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:45.064446 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:45.064448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.064850 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.064851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:45.064915 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:45.065407 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:45.065411 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:45.067343 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
W20260807 06:43:45.067504 26271 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:45.062596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49349 (local address 127.11.137.190:36733)
0807 06:43:45.062730 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:45.062732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:45.062749 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:43:45.062813 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:45.062814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:45.062831 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:45.062900 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:45.063264 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.063810 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.064556 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.064758 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.064847 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:45.067441 (+ 2594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:49349: BlockingRecv error: recv got EOF from 127.11.137.130:49349 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 06:43:45 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:45 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:45.192808 26274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:45.188050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:35353)
0807 06:43:45.188271 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:45.188283 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:45.188390 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:45.188618 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:45.188618 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:45.188801 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:45.188852 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:45.188854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.189522 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.189522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:45.190044 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:45.190045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.190410 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.190410 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:45.190450 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:45.190894 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:45.190899 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:45.192749 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":106,"threads_started":1}
W20260807 06:43:45.192973 26271 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:45.188165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:35353 (local address 127.11.137.190:36733)
0807 06:43:45.188266 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:45.188268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:45.188353 (+ 85us) server_negotiation.cc:407] Connection header received
0807 06:43:45.188511 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:45.188513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:45.188528 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:45.188591 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:45.188920 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.189454 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.190151 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.190340 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.190396 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:45.192872 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:35353: BlockingRecv error: recv got EOF from 127.11.137.131:35353 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 06:43:45 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:45 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:45.944146 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:45.934494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:55067)
0807 06:43:45.934616 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:45.934628 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:45.934694 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:45.934841 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:45.934841 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:45.935028 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:45.935089 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:45.935091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.936090 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.936091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:45.937147 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:45.937151 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.937738 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.937739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:45.937805 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:45.938386 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:45.938392 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:45.944040 (+ 5648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":68,"threads_started":1}
W20260807 06:43:45.945091 26276 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:45.934557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:55067 (local address 127.11.137.190:36733)
0807 06:43:45.934697 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:45.934699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:45.934737 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:43:45.934762 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:45.934762 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:45.934774 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:45.934837 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:45.935158 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.935994 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.937302 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:45.937637 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:45.937722 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:45.945000 (+ 7278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:55067: BlockingRecv error: recv got EOF from 127.11.137.129:55067 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
Aug 07 06:43:46 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:46 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:46.072723 26283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:46.067949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:37871)
0807 06:43:46.068126 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:46.068143 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:46.068207 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:46.068335 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:46.068336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:46.068537 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:46.068593 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:46.068595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.069316 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.069317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:46.069855 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:46.069857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.070197 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.070198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:46.070243 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:46.070758 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:46.070762 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:46.072661 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
W20260807 06:43:46.072834 26276 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:46.068093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:37871 (local address 127.11.137.190:36733)
0807 06:43:46.068162 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:46.068164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:46.068192 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:43:46.068266 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:46.068266 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:46.068277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:46.068328 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:46.068651 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.069167 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.069935 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.070121 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.070171 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:46.072763 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:37871: BlockingRecv error: recv got EOF from 127.11.137.130:37871 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 07 06:43:46 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:46 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:46.197623 26284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:46.193379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:36491)
0807 06:43:46.193500 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:46.193514 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:46.193569 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:46.193677 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:46.193678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:46.193854 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:46.193903 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:46.193904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.194527 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.194528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:46.195005 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:46.195006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.195305 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.195306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:46.195363 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:46.195825 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:46.195829 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:46.197553 (+ 1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
W20260807 06:43:46.197693 26276 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:46.193421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:36491 (local address 127.11.137.190:36733)
0807 06:43:46.193483 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:46.193485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:46.193569 (+ 84us) server_negotiation.cc:407] Connection header received
0807 06:43:46.193614 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:46.193614 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:46.193627 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:46.193673 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:46.193962 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.194461 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.195074 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.195244 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.195289 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:46.197643 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:36491: BlockingRecv error: recv got EOF from 127.11.137.131:36491 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 07 06:43:46 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:46 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:46.950263 26285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:46.945302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:50611)
0807 06:43:46.945458 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:46.945470 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:46.945531 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:46.945797 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:46.945798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:46.945965 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:46.946014 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:46.946015 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.946644 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.946644 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:46.947224 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:46.947226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.947584 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.947584 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:46.947623 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:46.948153 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:46.948158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:46.950192 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
W20260807 06:43:46.950394 26288 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:46.945523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:50611 (local address 127.11.137.190:36733)
0807 06:43:46.945661 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:46.945663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:46.945672 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:46.945703 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:46.945703 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:46.945713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:46.945774 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:46.946082 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.946579 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.947308 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:46.947513 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:46.947572 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:46.950280 (+ 2708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:50611: BlockingRecv error: recv got EOF from 127.11.137.129:50611 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
Aug 07 06:43:47 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:47 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:47.078051 26290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:47.073281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:39827)
0807 06:43:47.073468 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:47.073480 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:47.073555 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:47.073725 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:47.073727 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:47.073922 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:47.073973 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:47.073975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.074664 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.074666 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:47.075201 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:47.075203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.075581 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.075582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:47.075649 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:47.076122 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:47.076126 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:47.077993 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":93,"threads_started":1}
W20260807 06:43:47.078161 26288 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:47.073385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:39827 (local address 127.11.137.190:36733)
0807 06:43:47.073464 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:47.073467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:47.073535 (+ 68us) server_negotiation.cc:407] Connection header received
0807 06:43:47.073626 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:47.073627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:47.073640 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:47.073717 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:47.074065 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.074573 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.075295 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.075495 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.075574 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:47.078094 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:39827: BlockingRecv error: recv got EOF from 127.11.137.130:39827 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 06:43:47 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:47 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:47.202962 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:47.198114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:51913)
0807 06:43:47.198265 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:47.198275 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:47.198332 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:47.198488 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:47.198489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:47.198779 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:47.198847 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:47.198850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.199627 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.199628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:47.200200 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:47.200202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.200517 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.200518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:47.200556 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:47.201042 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:47.201046 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:47.202902 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
W20260807 06:43:47.203099 26288 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:47.198208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:51913 (local address 127.11.137.190:36733)
0807 06:43:47.198273 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:47.198275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:47.198316 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:43:47.198389 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:47.198390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:47.198402 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:47.198443 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:47.198962 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.199542 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.200268 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.200443 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.200504 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:47.202990 (+ 2486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:51913: BlockingRecv error: recv got EOF from 127.11.137.131:51913 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 06:43:47 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:47 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:47.955528 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:47.950768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:35869)
0807 06:43:47.950964 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:47.950974 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:47.951038 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:47.951166 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:47.951167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:47.951329 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:47.951380 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:47.951381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.952047 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.952048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:47.952569 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:47.952570 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.952951 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.952952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:47.953020 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:47.953640 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:47.953646 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:47.955466 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":131,"threads_started":1}
W20260807 06:43:47.955715 26293 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:47.950847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:35869 (local address 127.11.137.190:36733)
0807 06:43:47.950983 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:47.950985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:47.951034 (+ 49us) server_negotiation.cc:407] Connection header received
0807 06:43:47.951082 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:47.951083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:47.951093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:47.951160 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:47.951436 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.951959 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.952665 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:47.952859 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:47.952949 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:47.955619 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:35869: BlockingRecv error: recv got EOF from 127.11.137.129:35869 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
Aug 07 06:43:48 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:48 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:48.083446 26295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:48.078645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:52037)
0807 06:43:48.078811 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:48.078822 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:48.078898 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:48.079057 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:48.079057 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:48.079245 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:48.079298 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:48.079300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.079903 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.079904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:48.080412 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:48.080413 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.080798 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.080799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:48.080841 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:48.081337 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:48.081343 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:48.083386 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
W20260807 06:43:48.083567 26293 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:48.078769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:52037 (local address 127.11.137.190:36733)
0807 06:43:48.078827 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:48.078832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:48.078878 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:43:48.078963 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:48.078963 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:48.078974 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:48.079024 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:48.079367 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.079831 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.080525 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.080721 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.080784 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:48.083487 (+ 2703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:52037: BlockingRecv error: recv got EOF from 127.11.137.130:52037 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 07 06:43:48 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:48 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:48.208170 26296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:48.203448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:49477)
0807 06:43:48.203632 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:48.203644 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:48.203715 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:48.203855 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:48.203856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:48.204038 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:48.204089 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:48.204091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.204746 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.204746 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:48.205363 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:48.205365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.205717 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.205718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:48.205779 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:48.206233 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:48.206238 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:48.208110 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":88,"threads_started":1}
W20260807 06:43:48.208326 26293 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:48.203548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49477 (local address 127.11.137.190:36733)
0807 06:43:48.203652 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:48.203654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:48.203715 (+ 61us) server_negotiation.cc:407] Connection header received
0807 06:43:48.203774 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:48.203775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:48.203791 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:48.203837 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:48.204170 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.204671 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.205457 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.205640 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.205700 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:48.208235 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:49477: BlockingRecv error: recv got EOF from 127.11.137.131:49477 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 06:43:48 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:48 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:48.960711 26297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:48.956015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:50697)
0807 06:43:48.956202 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:48.956216 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:48.956322 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:48.956478 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:48.956479 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:48.956644 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:48.956699 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:48.956701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.957456 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.957456 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:48.957959 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:48.957961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.958288 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.958289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:48.958328 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:48.958873 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:48.958878 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:48.960646 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
W20260807 06:43:48.960857 26299 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:48.956151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:50697 (local address 127.11.137.190:36733)
0807 06:43:48.956344 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:48.956346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:48.956355 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:48.956389 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:48.956390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:48.956400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:48.956460 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:48.956770 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.957389 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.958026 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:48.958222 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:48.958273 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:48.960747 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:50697: BlockingRecv error: recv got EOF from 127.11.137.129:50697 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":84,"threads_started":1}
Aug 07 06:43:49 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:49 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:49.088763 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:49.083924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:49211)
0807 06:43:49.084052 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:49.084105 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:49.084175 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:49.084349 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:49.084350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:49.084538 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:49.084589 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:49.084592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.085449 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.085450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:49.085991 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:49.085993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.086365 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.086366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:49.086424 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:49.086913 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:49.086918 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:49.088705 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
W20260807 06:43:49.088886 26299 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:49.084043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49211 (local address 127.11.137.190:36733)
0807 06:43:49.084111 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:49.084113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:49.084156 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:43:49.084258 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:49.084259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:49.084278 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:49.084340 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:49.084673 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.085354 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.086080 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.086285 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.086365 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:49.088808 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:49211: BlockingRecv error: recv got EOF from 127.11.137.130:49211 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 06:43:49 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:49 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:49.213495 26301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:49.208746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:37041)
0807 06:43:49.208900 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:49.208917 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:49.208968 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:49.209124 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:49.209125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:49.209368 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:49.209419 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:49.209422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.210198 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.210199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:49.210759 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:49.210761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.211074 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.211075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:49.211119 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:49.211549 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:49.211553 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:49.213427 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
W20260807 06:43:49.213615 26299 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:49.208934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:37041 (local address 127.11.137.190:36733)
0807 06:43:49.208999 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:49.209000 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:49.209008 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:49.209032 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:49.209033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:49.209045 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:49.209098 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:49.209494 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.210110 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.210829 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.211007 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.211060 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:49.213536 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:37041: BlockingRecv error: recv got EOF from 127.11.137.131:37041 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 07 06:43:49 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:49 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:49.970252 26302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:49.961162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:32979)
0807 06:43:49.961357 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:49.961372 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:49.961455 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:49.961633 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:49.961635 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:49.961840 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:49.961886 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:49.961888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.962620 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.962621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:49.963147 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:49.963148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.963537 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.963538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:49.963614 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:49.968237 (+ 4623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:49.968242 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:49.970173 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":120,"threads_started":1}
W20260807 06:43:49.970396 26303 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:49.961267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:32979 (local address 127.11.137.190:36733)
0807 06:43:49.961390 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:49.961393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:49.961430 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:43:49.961513 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:49.961514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:49.961527 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:49.961617 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:49.961975 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.962518 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.963240 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:49.963444 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:49.963533 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:49.970289 (+ 6756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:32979: BlockingRecv error: recv got EOF from 127.11.137.129:32979 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":50,"threads_started":1}
Aug 07 06:43:50 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:50 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:50.094174 26304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:50.089351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:57423)
0807 06:43:50.089532 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:50.089544 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:50.089659 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:50.089847 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:50.089848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:50.090030 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:50.090080 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:50.090082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.090733 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.090734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:50.091244 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:50.091246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.091609 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.091610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:50.091676 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:50.092170 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:50.092175 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:50.094093 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":92,"threads_started":1}
W20260807 06:43:50.094239 26303 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:50.089441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:57423 (local address 127.11.137.190:36733)
0807 06:43:50.089522 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:50.089525 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:50.089625 (+ 100us) server_negotiation.cc:407] Connection header received
0807 06:43:50.089748 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:50.089748 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:50.089760 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:50.089824 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:50.090167 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.090649 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.091333 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.091529 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.091607 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:50.094192 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:57423: BlockingRecv error: recv got EOF from 127.11.137.130:57423 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 06:43:50 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:50 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:50.219069 26310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:50.214074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:47781)
0807 06:43:50.214309 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:50.214322 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:50.214388 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:50.214583 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:50.214584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:50.214865 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:50.214915 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:50.214917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.215585 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.215586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:50.216148 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:50.216150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.216539 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.216540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:50.216604 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:50.217039 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:50.217044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:50.219011 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":151,"threads_started":1}
W20260807 06:43:50.219202 26303 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:50.214177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:47781 (local address 127.11.137.190:36733)
0807 06:43:50.214237 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:50.214239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:50.214391 (+ 152us) server_negotiation.cc:407] Connection header received
0807 06:43:50.214489 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:50.214490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:50.214506 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:50.214570 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:50.215008 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.215471 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.216240 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.216439 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.216535 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:50.219115 (+ 2580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:47781: BlockingRecv error: recv got EOF from 127.11.137.131:47781 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 07 06:43:50 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:50 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:50.975256 26311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:50.970730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:36231)
0807 06:43:50.970879 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:50.970890 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:50.970949 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:50.971095 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:50.971096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:50.971277 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:50.971327 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:50.971329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.971956 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.971957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:50.972472 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:50.972473 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.972804 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.972805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:50.972843 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:50.973356 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:50.973361 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:50.975161 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
W20260807 06:43:50.975324 26313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:50.970798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:36231 (local address 127.11.137.190:36733)
0807 06:43:50.970904 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:50.970906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:50.970931 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:43:50.971011 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:50.971012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:50.971022 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:50.971080 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:50.971383 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.971890 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.972539 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:50.972741 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:50.972791 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:50.975254 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:36231: BlockingRecv error: recv got EOF from 127.11.137.129:36231 (error 108)
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":53,"threads_started":1}
Aug 07 06:43:51 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:51 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:51.099772 26314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:51.094733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:45093)
0807 06:43:51.094914 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:51.094926 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:51.094990 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:51.095151 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:51.095152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:51.095339 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:51.095393 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:51.095395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.096035 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.096035 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:51.096617 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:51.096618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.096949 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.096949 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:51.097003 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:51.097555 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:51.097561 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:51.099713 (+ 2152us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
W20260807 06:43:51.099907 26313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:51.094789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:45093 (local address 127.11.137.190:36733)
0807 06:43:51.094882 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:51.094884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:51.094989 (+ 105us) server_negotiation.cc:407] Connection header received
0807 06:43:51.095056 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:51.095057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:51.095068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:51.095122 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:51.095461 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.095950 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.096699 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.096881 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.096930 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:51.099825 (+ 2895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:45093: BlockingRecv error: recv got EOF from 127.11.137.130:45093 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 06:43:51 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:51 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:51.224243 26316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:51.219531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:47227)
0807 06:43:51.219671 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:51.219688 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:51.219760 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:51.219893 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:51.219894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:51.220058 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:51.220108 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:51.220110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.220730 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.220731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:51.221247 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:51.221248 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.221645 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.221646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:51.221712 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:51.222240 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:51.222245 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:51.224133 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
W20260807 06:43:51.224296 26313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:51.219678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:47227 (local address 127.11.137.190:36733)
0807 06:43:51.219727 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:51.219729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:51.219736 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:43:51.219804 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:51.219805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:51.219818 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:51.219873 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:51.220176 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.220660 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.221339 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.221553 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.221641 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:51.224228 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:47227: BlockingRecv error: recv got EOF from 127.11.137.131:47227 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 07 06:43:51 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:51 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:51.980489 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:51.975755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:46985)
0807 06:43:51.975917 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:51.975928 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:51.975984 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:51.976129 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:51.976130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:51.976311 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:51.976363 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:51.976364 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.977008 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.977009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:51.977588 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:51.977591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.977940 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.977941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:51.977982 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:51.978431 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:51.978436 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:51.980416 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
W20260807 06:43:51.980593 26321 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:51.975837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:46985 (local address 127.11.137.190:36733)
0807 06:43:51.975951 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:51.975952 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:51.975964 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:51.976040 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:51.976041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:51.976052 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:51.976105 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:51.976433 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.976937 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.977669 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:51.977871 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:51.977924 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:51.980514 (+ 2590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:46985: BlockingRecv error: recv got EOF from 127.11.137.129:46985 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":53,"threads_started":1}
Aug 07 06:43:52 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:52 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:52.104717 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:52.100197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:48073)
0807 06:43:52.100364 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:52.100374 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:52.100433 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:52.100550 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:52.100551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:52.100740 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:52.100790 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:52.100792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.101458 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.101459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:52.101953 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:52.101954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.102264 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.102265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:52.102300 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:52.102761 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:52.102765 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:52.104595 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":97,"threads_started":1}
W20260807 06:43:52.104741 26321 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:52.100271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:48073 (local address 127.11.137.190:36733)
0807 06:43:52.100323 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:52.100326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:52.100418 (+ 92us) server_negotiation.cc:407] Connection header received
0807 06:43:52.100481 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:52.100481 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:52.100492 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:52.100538 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:52.100851 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.101391 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.102018 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.102201 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.102247 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:52.104679 (+ 2432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:48073: BlockingRecv error: recv got EOF from 127.11.137.130:48073 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 07 06:43:52 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:52 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:52.229674 26327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:52.224823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:40471)
0807 06:43:52.225023 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:52.225034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:52.225107 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:52.225311 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:52.225312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:52.225509 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:52.225555 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:52.225556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.226250 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.226251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:52.226806 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:52.226808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.227173 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.227174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:52.227235 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:52.227824 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:52.227829 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:52.229605 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":126,"threads_started":1}
W20260807 06:43:52.229790 26321 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:52.224917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:40471 (local address 127.11.137.190:36733)
0807 06:43:52.225002 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:52.225004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:52.225111 (+ 107us) server_negotiation.cc:407] Connection header received
0807 06:43:52.225175 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:52.225176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:52.225193 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:52.225286 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:52.225649 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.226154 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.226894 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.227094 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.227175 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:52.229698 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:40471: BlockingRecv error: recv got EOF from 127.11.137.131:40471 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 06:43:52 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:52 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:52.986030 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:52.981090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:41841)
0807 06:43:52.981312 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:52.981330 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:52.981386 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:52.981533 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:52.981534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:52.981721 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:52.981772 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:52.981773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.982589 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.982591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:52.983204 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:52.983206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.983545 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.983546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:52.983592 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:52.984045 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:52.984050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:52.985971 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":149,"threads_started":1}
W20260807 06:43:52.986207 26330 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:52.981244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:41841 (local address 127.11.137.190:36733)
0807 06:43:52.981379 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:52.981381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:52.981390 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:52.981446 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:52.981447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:52.981457 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:52.981508 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:52.981844 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.982507 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.983281 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:52.983473 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:52.983527 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:52.986083 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:41841: BlockingRecv error: recv got EOF from 127.11.137.129:41841 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":56,"threads_started":1}
Aug 07 06:43:53 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:53 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:53.110209 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:53.105364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:40905)
0807 06:43:53.105636 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:53.105649 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:53.105724 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:53.105853 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:53.105854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:53.106043 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:53.106089 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:53.106091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.106790 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.106791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:53.107324 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:53.107326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.107714 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.107715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:53.107773 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:53.108272 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:53.108278 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:53.110149 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":92,"threads_started":1}
W20260807 06:43:53.110353 26330 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:53.105464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:40905 (local address 127.11.137.190:36733)
0807 06:43:53.105640 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:53.105642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:53.105704 (+ 62us) server_negotiation.cc:407] Connection header received
0807 06:43:53.105780 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:53.105781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:53.105794 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:53.105839 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:53.106175 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.106694 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.107424 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.107622 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.107712 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:53.110275 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:40905: BlockingRecv error: recv got EOF from 127.11.137.130:40905 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
Aug 07 06:43:53 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:53 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:53.234663 26335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:53.230162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:48769)
0807 06:43:53.230313 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:53.230325 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:53.230393 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:53.230502 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:53.230503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:53.230667 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:53.230723 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:53.230725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.231328 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.231328 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:53.231865 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:53.231866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.232185 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.232186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:53.232227 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:53.232660 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:53.232665 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:53.234565 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
W20260807 06:43:53.234714 26330 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:53.230232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:48769 (local address 127.11.137.190:36733)
0807 06:43:53.230300 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:53.230302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:53.230377 (+ 75us) server_negotiation.cc:407] Connection header received
0807 06:43:53.230445 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:53.230446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:53.230458 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:53.230497 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:53.230784 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.231256 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.231938 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.232120 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.232169 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:53.234647 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:48769: BlockingRecv error: recv got EOF from 127.11.137.131:48769 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 06:43:53 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:53 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:53.991791 26336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:53.986581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:50741)
0807 06:43:53.986719 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:53.986731 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:53.986800 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:53.987007 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:53.987008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:53.987272 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:53.987348 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:53.987351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.988106 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.988107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:53.988739 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:53.988741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.989127 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.989128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:53.989186 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:53.989785 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:53.989790 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:53.991692 (+ 1902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
W20260807 06:43:53.991881 26338 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:53.986641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:50741 (local address 127.11.137.190:36733)
0807 06:43:53.986774 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:53.986777 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:53.986789 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:53.986891 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:53.986892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:53.986907 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:53.986991 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:53.987432 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.987965 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.988824 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:53.989042 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:53.989116 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:53.991813 (+ 2697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:50741: BlockingRecv error: recv got EOF from 127.11.137.129:50741 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
Aug 07 06:43:54 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:54 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:54.115542 26342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:54.110819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:48855)
0807 06:43:54.111028 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:54.111040 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:54.111112 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:54.111257 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:54.111257 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:54.111425 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:54.111473 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:54.111475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.112167 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.112168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:54.112728 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:54.112729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.113077 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.113078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:54.113118 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:54.113712 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:54.113717 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:54.115474 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":111,"threads_started":1}
W20260807 06:43:54.115634 26338 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:54.110967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:48855 (local address 127.11.137.190:36733)
0807 06:43:54.111083 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:54.111085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:54.111107 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:43:54.111176 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:54.111177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:54.111187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:54.111235 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:54.111537 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.112098 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.112800 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.112992 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.113063 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:54.115570 (+ 2507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:48855: BlockingRecv error: recv got EOF from 127.11.137.130:48855 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 07 06:43:54 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:54 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:54.240459 26343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:54.235298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:44227)
0807 06:43:54.235444 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:54.235464 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:54.235524 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:54.235647 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:54.235648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:54.235831 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:54.235880 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:54.235881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.236581 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.236581 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:54.237385 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:54.237388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.237726 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.237727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:54.237765 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:54.238301 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:54.238306 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:54.240331 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
W20260807 06:43:54.240502 26338 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:54.235392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:44227 (local address 127.11.137.190:36733)
0807 06:43:54.235457 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:54.235459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:54.235527 (+ 68us) server_negotiation.cc:407] Connection header received
0807 06:43:54.235585 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:54.235586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:54.235598 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:54.235641 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:54.235940 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.236483 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.237466 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.237658 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.237714 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:54.240428 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:44227: BlockingRecv error: recv got EOF from 127.11.137.131:44227 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 06:43:54 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:54 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:55.003017 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:54.992298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:52793)
0807 06:43:54.992458 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:54.992469 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:54.992530 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:54.992679 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:54.992680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:54.992856 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:54.992906 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:54.992907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.993562 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.993563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:54.994062 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:54.994063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.994391 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.994392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:54.994430 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:55.000869 (+ 6439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:55.000875 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:55.002957 (+ 2082us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
W20260807 06:43:55.003180 26345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:54.992384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:52793 (local address 127.11.137.190:36733)
0807 06:43:54.992497 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:54.992498 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:54.992511 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:43:54.992595 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:54.992596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:54.992606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:54.992658 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:54.992975 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.993494 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.994136 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:54.994325 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:54.994375 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:55.003078 (+ 8703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:52793: BlockingRecv error: recv got EOF from 127.11.137.129:52793 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
Aug 07 06:43:55 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:55 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:55.121434 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:55.116037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:49399)
0807 06:43:55.116172 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:55.116182 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:55.116251 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:55.116448 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:55.116449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:55.116706 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:55.116757 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:55.116759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.117611 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.117612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:55.118517 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:55.118520 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.118853 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.118853 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:55.118893 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:55.119316 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:55.119321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:55.121375 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
W20260807 06:43:55.121546 26345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:55.116214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:49399 (local address 127.11.137.190:36733)
0807 06:43:55.116292 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:55.116294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:55.116302 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:43:55.116329 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:55.116330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:55.116369 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:55.116437 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:55.116841 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.117513 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.118588 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.118780 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.118839 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:55.121472 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:49399: BlockingRecv error: recv got EOF from 127.11.137.130:49399 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 06:43:55 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:55 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.131@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:55.245424 26348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:55.240966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.131:36759)
0807 06:43:55.241087 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:55.241106 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:55.241163 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:55.241346 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:55.241347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:55.241518 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:55.241567 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:55.241569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.242189 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.242190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:55.242679 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:55.242680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.243009 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.243010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:55.243050 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:55.243500 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:55.243504 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:55.245364 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
W20260807 06:43:55.245520 26345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:55.241035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:36759 (local address 127.11.137.190:36733)
0807 06:43:55.241116 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:55.241118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:55.241147 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:43:55.241254 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:55.241255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:55.241270 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:55.241330 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:55.241629 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.242115 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.242747 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:55.242920 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:55.242994 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:55.245452 (+ 2458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.131:36759: BlockingRecv error: recv got EOF from 127.11.137.131:36759 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 06:43:56 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:56 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.129@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:56.008123 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.003638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.129:35419)
0807 06:43:56.003798 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:56.003809 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:56.003871 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:56.004046 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:56.004046 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:56.004220 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:56.004272 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.004274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.004899 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.004900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.005478 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.005481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.005818 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.005818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.005857 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.006286 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:56.006290 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:56.008064 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
W20260807 06:43:56.008249 26350 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:56.003721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:35419 (local address 127.11.137.190:36733)
0807 06:43:56.003827 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.003829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.003854 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:43:56.003939 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.003940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.003952 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.004028 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.004332 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.004833 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.005547 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.005752 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.005806 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.008161 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.129:35419: BlockingRecv error: recv got EOF from 127.11.137.129:35419 (error 108)
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":54,"threads_started":1}
Aug 07 06:43:56 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:43:56 dist-test-slave-8hhm krb5kdc[24432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.137.130@KRBTEST.COM for oryx/127.11.137.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:43:56.126334 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.121957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36733 (local address 127.11.137.130:58343)
0807 06:43:56.122099 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:56.122109 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:56.122167 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:56.122301 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:56.122302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:56.122459 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:56.122509 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.122511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.123121 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.123122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.123658 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.123659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.123983 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.123984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.124024 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.124434 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:56.124438 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:56.126278 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.137.190:36733: Server oryx/127.11.137.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
W20260807 06:43:56.126488 26350 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:56.122011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:58343 (local address 127.11.137.190:36733)
0807 06:43:56.122073 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.122075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.122165 (+ 90us) server_negotiation.cc:407] Connection header received
0807 06:43:56.122228 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.122229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.122240 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.122284 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.122567 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.123056 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.123737 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.123919 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.123968 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.126386 (+ 2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.137.130:58343: BlockingRecv error: recv got EOF from 127.11.137.130:58343 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:43:56.170468 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 25523
I20260807 06:43:56.186479 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 25782
I20260807 06:43:56.198848 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 26020
I20260807 06:43:56.207338 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 25396
2026-08-07T06:43:56Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17770 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T06:43:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:56Z Disabled control of system clock
I20260807 06:43:56.247120 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:35487
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:43647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:35487
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 06:43:56.328284 26363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:56.328475 26363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:56.328495 26363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:56.329609 26363 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:56.329644 26363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:56.329658 26363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:56.329670 26363 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:56.329682 26363 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:56.330955 26363 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:35487
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:35487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:56.331141 26363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:56.331374 26363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:56.336570 26376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.336587 26370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.336618 26368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.336615 26363 server_base.cc:1034] running on GCE node
I20260807 06:43:56.337007 26363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:56.337375 26363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:56.338528 26363 hybrid_clock.cc:648] HybridClock initialized: now 1786085036338504 us; error 39 us; skew 500 ppm
I20260807 06:43:56.339803 26363 webserver.cc:460] Webserver started at http://127.11.137.190:39283/ using document root <none> and password file <none>
I20260807 06:43:56.340051 26363 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:56.340114 26363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:56.340291 26363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:56.341419 26363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "fb1b3e7b25a44169903de95747b8c986"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "884996dbf1c014e971cc2519a2d871fe"
server_key_iv: "81f5004de498b27cef777757131c04d1"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.341785 26363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "fb1b3e7b25a44169903de95747b8c986"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "884996dbf1c014e971cc2519a2d871fe"
server_key_iv: "81f5004de498b27cef777757131c04d1"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.343120 26363 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:56.343822 26389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.344000 26363 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:56.344126 26363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "fb1b3e7b25a44169903de95747b8c986"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "884996dbf1c014e971cc2519a2d871fe"
server_key_iv: "81f5004de498b27cef777757131c04d1"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.344205 26363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:56.353565 26363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:56.353857 26363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:56.354010 26363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:56.357993 26363 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:35487
I20260807 06:43:56.358040 26472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:35487 every 8 connection(s)
I20260807 06:43:56.358385 26363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:56.359093 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:56.361495 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 26363
I20260807 06:43:56.361606 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:56.361824 11814 external_mini_cluster.cc:1428] Setting key a263bcf1dbea3ec35be60f3388f25bd4
I20260807 06:43:56.361836 26473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986: Bootstrap starting.
I20260807 06:43:56.362607 26473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:56.362942 26473 log.cc:824] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:56.363704 26473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986: No bootstrap required, opened a new log
I20260807 06:43:56.365533 26473 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b3e7b25a44169903de95747b8c986" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35487 } }
I20260807 06:43:56.365666 26473 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:56.365692 26473 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb1b3e7b25a44169903de95747b8c986, State: Initialized, Role: FOLLOWER
I20260807 06:43:56.365849 26473 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b3e7b25a44169903de95747b8c986" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35487 } }
I20260807 06:43:56.366160 26473 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:56.366206 26473 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:56.366254 26473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:56.366956 26473 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b3e7b25a44169903de95747b8c986" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35487 } }
I20260807 06:43:56.367079 26473 leader_election.cc:302] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb1b3e7b25a44169903de95747b8c986; no voters:
I20260807 06:43:56.367259 26473 leader_election.cc:288] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:56.367332 26480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:56.367489 26480 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [term 1 LEADER]: Becoming Leader. State: Replica: fb1b3e7b25a44169903de95747b8c986, State: Running, Role: LEADER
I20260807 06:43:56.367589 26473 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:56.367659 26480 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b3e7b25a44169903de95747b8c986" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35487 } }
I20260807 06:43:56.368036 26482 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb1b3e7b25a44169903de95747b8c986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b3e7b25a44169903de95747b8c986" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35487 } } }
I20260807 06:43:56.368137 26482 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:56.368021 26480 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb1b3e7b25a44169903de95747b8c986. Latest consensus state: current_term: 1 leader_uuid: "fb1b3e7b25a44169903de95747b8c986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b3e7b25a44169903de95747b8c986" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35487 } } }
I20260807 06:43:56.368439 26494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:56.368615 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.362383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47032 (local address 127.11.137.190:35487)
0807 06:43:56.362609 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.362618 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.362653 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:43:56.363236 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.363244 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.363301 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.363458 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.363624 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.364967 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.365872 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.366496 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.366643 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.367342 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:56.367346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:56.367347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:56.367564 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:56.367609 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:56.367623 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:56.367866 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:56.367898 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 06:43:56.367985 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260807 06:43:56.368443 26480 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:56.368978 26494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:56.370658 26494 catalog_manager.cc:1347] Generated new cluster ID: 76794e85e7c1461f95285807d6109ac3
I20260807 06:43:56.370712 26494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:56.378213 26494 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:56.378693 26494 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:56.383894 26494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb1b3e7b25a44169903de95747b8c986: Generated new TSK 0
I20260807 06:43:56.384068 26494 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:56.386024 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35487
--builtin_ntp_servers=127.11.137.148:43647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 06:43:56.468218 26512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:56.468590 26512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:56.468652 26512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:56.469846 26512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:56.469883 26512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:56.469906 26512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:56.471235 26512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:56.471489 26512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:56.471819 26512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:56.478085 26522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.478096 26526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.478396 26512 server_base.cc:1034] running on GCE node
W20260807 06:43:56.478096 26521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.478700 26512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:56.479010 26512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:56.480187 26512 hybrid_clock.cc:648] HybridClock initialized: now 1786085036480172 us; error 29 us; skew 500 ppm
I20260807 06:43:56.481691 26512 webserver.cc:460] Webserver started at http://127.11.137.129:41001/ using document root <none> and password file <none>
I20260807 06:43:56.481966 26512 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:56.482019 26512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:56.482229 26512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:56.483501 26512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "49160ecc267d4a67b09aaa9b4100de94"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "e4c5009eda44666c9f08646d5d75dc33"
server_key_iv: "816ea05af860c5daf8ba3eb8b798f3f0"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.483922 26512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "49160ecc267d4a67b09aaa9b4100de94"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "e4c5009eda44666c9f08646d5d75dc33"
server_key_iv: "816ea05af860c5daf8ba3eb8b798f3f0"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.485494 26512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260807 06:43:56.486393 26540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.486613 26512 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:56.486737 26512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "49160ecc267d4a67b09aaa9b4100de94"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "e4c5009eda44666c9f08646d5d75dc33"
server_key_iv: "816ea05af860c5daf8ba3eb8b798f3f0"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.486828 26512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:56.528360 26512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:56.528767 26512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:56.528951 26512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:56.529250 26512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:56.529637 26512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:56.529703 26512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.529749 26512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:56.529803 26512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.536401 26512 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:44673
I20260807 06:43:56.536444 26760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:44673 every 8 connection(s)
I20260807 06:43:56.536840 26512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:56.542336 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 26512
I20260807 06:43:56.542436 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:56.542655 11814 external_mini_cluster.cc:1428] Setting key ceef2ab4f06e4c46b5224e47775ff619
I20260807 06:43:56.542735 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.537681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:38443 (local address 127.11.137.190:35487)
0807 06:43:56.537740 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.537742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.537955 (+ 213us) server_negotiation.cc:407] Connection header received
0807 06:43:56.538567 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.538569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.538583 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.538649 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.539384 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.539940 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.541026 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.541336 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.541423 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.542402 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:56.542404 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:56.542404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:56.542409 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:56.542425 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:56.542429 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:56.542486 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:56.542630 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 06:43:56.542652 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 06:43:56.542995 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.537619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35487 (local address 127.11.137.129:38443)
0807 06:43:56.537829 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:56.537865 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:56.538441 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:56.538723 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:56.538727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:56.538738 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:56.539273 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.539278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.540068 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.540069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.540916 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.540918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.541438 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.541439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.541600 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.542226 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:56.542226 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:56.542264 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:56.542287 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:56.542514 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:56.542523 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:56.542527 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:56.542623 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 06:43:56.542735 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260807 06:43:56.543597 26761 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35487
I20260807 06:43:56.543655 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35487
--builtin_ntp_servers=127.11.137.148:43647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 06:43:56.543696 26761 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:56.543890 26761 heartbeater.cc:511] Master 127.11.137.190:35487 requested a full tablet report, sending...
I20260807 06:43:56.544458 26416 ts_manager.cc:194] Registered new tserver with Master: 49160ecc267d4a67b09aaa9b4100de94 (127.11.137.129:44673)
I20260807 06:43:56.545399 26416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.129:38443
W20260807 06:43:56.629338 26767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:56.629578 26767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:56.629612 26767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:56.630744 26767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:56.630813 26767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:56.630852 26767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:56.632254 26767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:56.632534 26767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:56.632833 26767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:56.637954 26776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.638013 26767 server_base.cc:1034] running on GCE node
W20260807 06:43:56.637931 26780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.637925 26777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.638422 26767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:56.638705 26767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:56.639851 26767 hybrid_clock.cc:648] HybridClock initialized: now 1786085036639840 us; error 28 us; skew 500 ppm
I20260807 06:43:56.641094 26767 webserver.cc:460] Webserver started at http://127.11.137.130:42989/ using document root <none> and password file <none>
I20260807 06:43:56.641391 26767 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:56.641443 26767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:56.641585 26767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:56.642627 26767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "efe71c8dd39f483e937557381c57499e"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "fc63b946db30585c4ffdf92104826e3f"
server_key_iv: "830da5a54c457169a6f3153fe118cf60"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.643005 26767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "efe71c8dd39f483e937557381c57499e"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "fc63b946db30585c4ffdf92104826e3f"
server_key_iv: "830da5a54c457169a6f3153fe118cf60"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.644239 26767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:56.644910 26791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.645068 26767 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:56.645179 26767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "efe71c8dd39f483e937557381c57499e"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "fc63b946db30585c4ffdf92104826e3f"
server_key_iv: "830da5a54c457169a6f3153fe118cf60"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.645272 26767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:56.655215 26767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:56.655480 26767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:56.655635 26767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:56.655836 26767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:56.656136 26767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:56.656188 26767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.656226 26767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:56.656253 26767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.662247 26767 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:36231
I20260807 06:43:56.662295 26977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:36231 every 8 connection(s)
I20260807 06:43:56.662582 26767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:56.667227 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.663271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:32879 (local address 127.11.137.190:35487)
0807 06:43:56.663317 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.663319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.663523 (+ 204us) server_negotiation.cc:407] Connection header received
0807 06:43:56.663955 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.663956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.663966 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.664021 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.664599 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.665058 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.665999 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.666168 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.666222 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.667028 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:56.667029 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:56.667029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:56.667033 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:56.667043 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:56.667046 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:56.667082 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:56.667144 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 06:43:56.667162 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:43:56.667398 26982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.663219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35487 (local address 127.11.137.130:32879)
0807 06:43:56.663404 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:56.663448 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:56.663876 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:56.664068 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:56.664071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:56.664079 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:56.664535 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.664538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.665154 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.665155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.665926 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.665929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.666245 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.666245 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.666345 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.666910 (+ 565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:56.666911 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:56.666937 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:56.666958 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:56.667085 (+ 127us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:56.667087 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:56.667089 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:56.667139 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 06:43:56.667209 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260807 06:43:56.667932 26978 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35487
I20260807 06:43:56.668035 26978 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:56.668213 26978 heartbeater.cc:511] Master 127.11.137.190:35487 requested a full tablet report, sending...
I20260807 06:43:56.668609 26416 ts_manager.cc:194] Registered new tserver with Master: efe71c8dd39f483e937557381c57499e (127.11.137.130:36231)
I20260807 06:43:56.669036 26416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.130:32879
I20260807 06:43:56.669849 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 26767
I20260807 06:43:56.669924 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:56.670095 11814 external_mini_cluster.cc:1428] Setting key d649936cf11a727665d7d30b2ea84415
I20260807 06:43:56.671057 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35487
--builtin_ntp_servers=127.11.137.148:43647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 06:43:56.751675 26983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:56.751935 26983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:56.751972 26983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:56.753113 26983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:56.753176 26983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:56.753216 26983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:56.754535 26983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:56.754792 26983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:56.755061 26983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:56.759939 26990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.759949 26997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.759984 26992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.760350 26983 server_base.cc:1034] running on GCE node
I20260807 06:43:56.760601 26983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:56.760851 26983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:56.762023 26983 hybrid_clock.cc:648] HybridClock initialized: now 1786085036762005 us; error 28 us; skew 500 ppm
I20260807 06:43:56.763398 26983 webserver.cc:460] Webserver started at http://127.11.137.131:39069/ using document root <none> and password file <none>
I20260807 06:43:56.763640 26983 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:56.763712 26983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:56.763900 26983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:56.765030 26983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "30bcb27b76c3401b9f9a75cfc239e575"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "0a092634e595e0df2634972fe56a81af"
server_key_iv: "bf645427c1e90511aba973a2bdb2e06b"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.765441 26983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "30bcb27b76c3401b9f9a75cfc239e575"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "0a092634e595e0df2634972fe56a81af"
server_key_iv: "bf645427c1e90511aba973a2bdb2e06b"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.767072 26983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:43:56.767843 27004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.768029 26983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:56.768179 26983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "30bcb27b76c3401b9f9a75cfc239e575"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "0a092634e595e0df2634972fe56a81af"
server_key_iv: "bf645427c1e90511aba973a2bdb2e06b"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.768249 26983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:56.782078 26983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:56.782373 26983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:56.782533 26983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:56.782773 26983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:56.783121 26983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:56.783160 26983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.783185 26983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:56.783239 26983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.789645 26983 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:43841
I20260807 06:43:56.789724 27207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:43841 every 8 connection(s)
I20260807 06:43:56.790058 26983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:56.795034 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.790854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49009 (local address 127.11.137.190:35487)
0807 06:43:56.790904 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.790906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.791131 (+ 225us) server_negotiation.cc:407] Connection header received
0807 06:43:56.791596 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.791597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.791609 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.791681 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.792355 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.792845 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.793844 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.794029 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.794084 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.794803 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:56.794804 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:56.794804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:56.794809 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:56.794822 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:56.794825 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:56.794867 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:56.794947 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 06:43:56.794968 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:43:56.795182 27212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:56.790800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35487 (local address 127.11.137.131:49009)
0807 06:43:56.790997 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:56.791037 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:56.791508 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:56.791746 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:56.791749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:56.791756 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:56.792241 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.792245 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.792942 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.792943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.793765 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:56.793768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:56.794105 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:56.794106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:56.794210 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:56.794677 (+ 467us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:56.794678 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:56.794704 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:56.794724 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:56.794879 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:56.794883 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:56.794885 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:56.794933 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 06:43:56.795004 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260807 06:43:56.795715 27208 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35487
I20260807 06:43:56.795816 27208 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:56.795989 27208 heartbeater.cc:511] Master 127.11.137.190:35487 requested a full tablet report, sending...
I20260807 06:43:56.796386 26416 ts_manager.cc:194] Registered new tserver with Master: 30bcb27b76c3401b9f9a75cfc239e575 (127.11.137.131:43841)
I20260807 06:43:56.796752 26416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.131:49009
I20260807 06:43:56.796945 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 26983
I20260807 06:43:56.797045 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:56.797284 11814 external_mini_cluster.cc:1428] Setting key 20230c1ecfbfcaf50c1ebd05cf40ab85
I20260807 06:43:56.798194 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:43:56.799803 26478 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:56.799371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47036 (local address 127.11.137.190:35487)
0807 06:43:56.799414 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:56.799416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:56.799514 (+ 98us) server_negotiation.cc:407] Connection header received
0807 06:43:56.799573 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:56.799574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:56.799581 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:56.799620 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:56.799727 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47036: BlockingRecv error: recv got EOF from 127.0.0.1:47036 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:56.799925 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 26512
I20260807 06:43:56.823323 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 26767
I20260807 06:43:56.833477 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 26983
I20260807 06:43:56.843999 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 26363
2026-08-07T06:43:56Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (631 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T06:43:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:56Z Disabled control of system clock
I20260807 06:43:56.878582 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40141
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:43153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:40141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:43:56.974978 27226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:56.975172 27226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:56.975193 27226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:56.976366 27226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:56.976411 27226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:56.976423 27226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:56.976436 27226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:56.976485 27226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:56.977910 27226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:40141
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:56.978178 27226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:56.978464 27226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:56.983551 27237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:56.983533 27239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.983610 27226 server_base.cc:1034] running on GCE node
W20260807 06:43:56.983538 27236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:56.983968 27226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:56.984247 27226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:56.985386 27226 hybrid_clock.cc:648] HybridClock initialized: now 1786085036985374 us; error 28 us; skew 500 ppm
I20260807 06:43:56.986598 27226 webserver.cc:460] Webserver started at http://127.11.137.190:45063/ using document root <none> and password file <none>
I20260807 06:43:56.986788 27226 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:56.986863 27226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:56.987025 27226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:56.988119 27226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "b6234a1b51ff403fbe34e9a924e070e1"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "b880e17b22135ba035cdbaadc3d3fc75"
server_key_iv: "a93e567fcd4e56439479c737b531feee"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.988492 27226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "b6234a1b51ff403fbe34e9a924e070e1"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "b880e17b22135ba035cdbaadc3d3fc75"
server_key_iv: "a93e567fcd4e56439479c737b531feee"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.989851 27226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:56.990537 27247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:56.990697 27226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:56.990799 27226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "b6234a1b51ff403fbe34e9a924e070e1"
format_stamp: "Formatted at 2026-08-07 06:43:56 on dist-test-slave-8hhm"
server_key: "b880e17b22135ba035cdbaadc3d3fc75"
server_key_iv: "a93e567fcd4e56439479c737b531feee"
server_key_version: "encryptionkey@0"
I20260807 06:43:56.990880 27226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:56.994333 27226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:56.994608 27226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:56.994766 27226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:56.998812 27226 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:40141
I20260807 06:43:56.998862 27337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:40141 every 8 connection(s)
I20260807 06:43:56.999210 27226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:56.999866 27341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:57.002638 27341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1: Bootstrap starting.
I20260807 06:43:57.003245 27341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:57.003494 27341 log.cc:824] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:57.004115 27341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1: No bootstrap required, opened a new log
I20260807 06:43:57.005755 27341 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234a1b51ff403fbe34e9a924e070e1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40141 } }
I20260807 06:43:57.005892 27341 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:57.005913 27341 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6234a1b51ff403fbe34e9a924e070e1, State: Initialized, Role: FOLLOWER
I20260807 06:43:57.006044 27341 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234a1b51ff403fbe34e9a924e070e1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40141 } }
I20260807 06:43:57.006124 27341 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:57.006146 27341 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:57.006184 27341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:57.006675 27341 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234a1b51ff403fbe34e9a924e070e1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40141 } }
I20260807 06:43:57.006763 27341 leader_election.cc:302] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6234a1b51ff403fbe34e9a924e070e1; no voters:
I20260807 06:43:57.006879 27341 leader_election.cc:288] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:57.006948 27346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:57.007128 27341 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:57.007167 27346 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [term 1 LEADER]: Becoming Leader. State: Replica: b6234a1b51ff403fbe34e9a924e070e1, State: Running, Role: LEADER
I20260807 06:43:57.007233 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 27226
I20260807 06:43:57.007335 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:57.007335 27346 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234a1b51ff403fbe34e9a924e070e1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40141 } }
I20260807 06:43:57.007524 11814 external_mini_cluster.cc:1428] Setting key 92aacb510839718a1fe79087e9f9d65f
I20260807 06:43:57.007897 27348 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6234a1b51ff403fbe34e9a924e070e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234a1b51ff403fbe34e9a924e070e1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40141 } } }
I20260807 06:43:57.007972 27348 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:57.008486 27353 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6234a1b51ff403fbe34e9a924e070e1. Latest consensus state: current_term: 1 leader_uuid: "b6234a1b51ff403fbe34e9a924e070e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234a1b51ff403fbe34e9a924e070e1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40141 } } }
I20260807 06:43:57.008579 27353 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:57.008788 27366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:57.009370 27366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:57.010581 27375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.008318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51102 (local address 127.11.137.190:40141)
0807 06:43:57.008538 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:57.008547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:57.008638 (+ 91us) server_negotiation.cc:407] Connection header received
0807 06:43:57.008855 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:57.008863 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:57.008915 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:57.009028 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:57.010124 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:57.010127 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:57.010128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:57.010133 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:57.010179 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:57.010190 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:57.010268 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:57.010331 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 06:43:57.010389 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260807 06:43:57.011180 27366 catalog_manager.cc:1347] Generated new cluster ID: bfad4ce78a124556a4a3578a131dd187
I20260807 06:43:57.011267 27366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:57.021174 27366 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:57.021338 27366 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:57.026656 27366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6234a1b51ff403fbe34e9a924e070e1: Generated new TSK 0
I20260807 06:43:57.026851 27366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:43:57.028584 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40141
--builtin_ntp_servers=127.11.137.148:43153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:43:57.111431 27390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:57.111627 27390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:57.111649 27390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:57.112833 27390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:57.112872 27390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:57.112898 27390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:57.114257 27390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:57.114500 27390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:57.114817 27390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:57.120848 27398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:57.120874 27400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:57.121029 27404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:57.120921 27390 server_base.cc:1034] running on GCE node
I20260807 06:43:57.121353 27390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:57.121641 27390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:57.122809 27390 hybrid_clock.cc:648] HybridClock initialized: now 1786085037122792 us; error 36 us; skew 500 ppm
I20260807 06:43:57.124168 27390 webserver.cc:460] Webserver started at http://127.11.137.129:34259/ using document root <none> and password file <none>
I20260807 06:43:57.124420 27390 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:57.124491 27390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:57.124663 27390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:57.125780 27390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "fcd65026e69d4a9cb7ea5383d879e557"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "87ba7d4e4730a1ad302bf4aa4b0c9e7d"
server_key_iv: "ccc3e46902a3713b8d238a15386148cb"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.126144 27390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "fcd65026e69d4a9cb7ea5383d879e557"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "87ba7d4e4730a1ad302bf4aa4b0c9e7d"
server_key_iv: "ccc3e46902a3713b8d238a15386148cb"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.127506 27390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:57.128295 27411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.128551 27390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:57.128645 27390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "fcd65026e69d4a9cb7ea5383d879e557"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "87ba7d4e4730a1ad302bf4aa4b0c9e7d"
server_key_iv: "ccc3e46902a3713b8d238a15386148cb"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.128721 27390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:57.133545 27390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:57.133828 27390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:57.133960 27390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:57.134222 27390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:57.134588 27390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:57.134629 27390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.134656 27390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:57.134690 27390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.141836 27390 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:40855
I20260807 06:43:57.141871 27599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:40855 every 8 connection(s)
I20260807 06:43:57.142210 27390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:57.144105 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 27390
I20260807 06:43:57.144209 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:57.144439 11814 external_mini_cluster.cc:1428] Setting key ad9057646d1a8b871a01de806126b457
I20260807 06:43:57.145550 27375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.142918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:35983 (local address 127.11.137.190:40141)
0807 06:43:57.142973 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:57.142975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:57.143214 (+ 239us) server_negotiation.cc:407] Connection header received
0807 06:43:57.143717 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:57.143719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:57.143727 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:57.143771 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:57.145298 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:57.145299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:57.145299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:57.145304 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:57.145321 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:57.145326 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:57.145385 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:57.145464 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 06:43:57.145480 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:43:57.145692 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40141
--builtin_ntp_servers=127.11.137.148:43153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 06:43:57.145763 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.142888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40141 (local address 127.11.137.129:35983)
0807 06:43:57.143075 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:57.143115 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:57.143604 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:57.143860 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:57.143863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:57.143870 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:57.145101 (+ 1231us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:57.145101 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:57.145139 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:57.145178 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:57.145386 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:57.145392 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:57.145396 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:57.145475 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:43:57.145535 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260807 06:43:57.146193 27601 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40141
I20260807 06:43:57.146275 27601 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:57.146379 27601 heartbeater.cc:511] Master 127.11.137.190:40141 requested a full tablet report, sending...
I20260807 06:43:57.146823 27272 ts_manager.cc:194] Registered new tserver with Master: fcd65026e69d4a9cb7ea5383d879e557 (127.11.137.129:40855)
W20260807 06:43:57.227393 27604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:57.227587 27604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:57.227609 27604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:57.228788 27604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:57.228829 27604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:57.228855 27604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:57.230196 27604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:57.230430 27604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:57.230718 27604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:57.235989 27617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:57.236006 27622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:57.236006 27615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:57.236267 27604 server_base.cc:1034] running on GCE node
I20260807 06:43:57.236475 27604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:57.236670 27604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:57.237803 27604 hybrid_clock.cc:648] HybridClock initialized: now 1786085037237783 us; error 36 us; skew 500 ppm
I20260807 06:43:57.239013 27604 webserver.cc:460] Webserver started at http://127.11.137.130:35325/ using document root <none> and password file <none>
I20260807 06:43:57.239270 27604 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:57.239341 27604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:57.239495 27604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:57.240520 27604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "d8daa2cf57274c08920b2a497df88629"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "d8b371d95dc7b65af4e45f087b48298a"
server_key_iv: "ffbbee281a299a908e3db4d83ab45bef"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.240902 27604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "d8daa2cf57274c08920b2a497df88629"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "d8b371d95dc7b65af4e45f087b48298a"
server_key_iv: "ffbbee281a299a908e3db4d83ab45bef"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.242268 27604 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:43:57.242981 27632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.243181 27604 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:43:57.243287 27604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "d8daa2cf57274c08920b2a497df88629"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "d8b371d95dc7b65af4e45f087b48298a"
server_key_iv: "ffbbee281a299a908e3db4d83ab45bef"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.243364 27604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:57.246632 27604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:57.246897 27604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:57.247040 27604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:57.247257 27604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:57.247560 27604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:57.247625 27604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.247666 27604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:57.247694 27604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.253913 27604 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:38185
I20260807 06:43:57.253961 27826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:38185 every 8 connection(s)
I20260807 06:43:57.254266 27604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:57.256950 27375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.254907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:59951 (local address 127.11.137.190:40141)
0807 06:43:57.254990 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:57.254993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:57.255151 (+ 158us) server_negotiation.cc:407] Connection header received
0807 06:43:57.255564 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:57.255565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:57.255582 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:57.255634 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:57.256780 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:57.256781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:57.256781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:57.256784 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:57.256795 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:57.256798 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:57.256839 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:57.256888 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 06:43:57.256899 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:43:57.257161 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.254865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40141 (local address 127.11.137.130:59951)
0807 06:43:57.255041 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:57.255072 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:57.255486 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:57.255681 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:57.255685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:57.255693 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:57.256653 (+ 960us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:57.256653 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:57.256681 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:57.256710 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:57.256839 (+ 129us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:57.256841 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:57.256843 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:57.256888 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 06:43:57.256933 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":98,"threads_started":1}
I20260807 06:43:57.257658 27829 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40141
I20260807 06:43:57.257755 27829 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:57.257911 27829 heartbeater.cc:511] Master 127.11.137.190:40141 requested a full tablet report, sending...
I20260807 06:43:57.258277 27272 ts_manager.cc:194] Registered new tserver with Master: d8daa2cf57274c08920b2a497df88629 (127.11.137.130:38185)
I20260807 06:43:57.261205 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 27604
I20260807 06:43:57.261370 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:43:57.261560 11814 external_mini_cluster.cc:1428] Setting key f2995bf377ed9c70dece7522516203a0
I20260807 06:43:57.262400 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40141
--builtin_ntp_servers=127.11.137.148:43153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:43:57.344779 27834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:57.344971 27834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:57.344993 27834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:57.346208 27834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:57.346249 27834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:57.346275 27834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:57.347615 27834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:43153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:57.347805 27834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:57.348129 27834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:57.353129 27850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:57.353135 27853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:57.353165 27834 server_base.cc:1034] running on GCE node
W20260807 06:43:57.353147 27843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:57.353607 27834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:57.353849 27834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:57.355007 27834 hybrid_clock.cc:648] HybridClock initialized: now 1786085037355006 us; error 34 us; skew 500 ppm
I20260807 06:43:57.356199 27834 webserver.cc:460] Webserver started at http://127.11.137.131:44493/ using document root <none> and password file <none>
I20260807 06:43:57.356433 27834 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:57.356501 27834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:57.356635 27834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:57.357730 27834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "75442deef856435d8f48576e5d06c74b"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "6b516db2a0dc009ca8b0d57988eb5d31"
server_key_iv: "ec7495f96003057af4b568afa5a570b1"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.358093 27834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "75442deef856435d8f48576e5d06c74b"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "6b516db2a0dc009ca8b0d57988eb5d31"
server_key_iv: "ec7495f96003057af4b568afa5a570b1"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.359372 27834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:57.360162 27864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.360365 27834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:57.360461 27834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "75442deef856435d8f48576e5d06c74b"
format_stamp: "Formatted at 2026-08-07 06:43:57 on dist-test-slave-8hhm"
server_key: "6b516db2a0dc009ca8b0d57988eb5d31"
server_key_iv: "ec7495f96003057af4b568afa5a570b1"
server_key_version: "encryptionkey@0"
I20260807 06:43:57.360543 27834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:57.363775 27834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:57.364020 27834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:57.364159 27834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:57.364387 27834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:57.364705 27834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:57.364760 27834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.364799 27834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:57.364825 27834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:57.370707 27834 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:46775
I20260807 06:43:57.370793 28068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:46775 every 8 connection(s)
I20260807 06:43:57.371074 27834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:57.373979 27375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.371799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49115 (local address 127.11.137.190:40141)
0807 06:43:57.371869 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:57.371872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:57.372049 (+ 177us) server_negotiation.cc:407] Connection header received
0807 06:43:57.372499 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:57.372500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:57.372506 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:57.372580 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:57.373776 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:57.373777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:57.373778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:43:57.373781 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:57.373791 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:43:57.373795 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:57.373841 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:57.373918 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:43:57.373930 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:43:57.374133 28072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:57.371736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40141 (local address 127.11.137.131:49115)
0807 06:43:57.371938 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:57.371975 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:57.372379 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:57.372644 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:57.372647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:57.372655 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:57.373649 (+ 994us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:43:57.373649 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:57.373674 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:43:57.373701 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:57.373853 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:57.373858 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:57.373860 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:43:57.373915 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 06:43:57.373958 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260807 06:43:57.374686 28069 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40141
I20260807 06:43:57.374776 28069 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:57.374940 28069 heartbeater.cc:511] Master 127.11.137.190:40141 requested a full tablet report, sending...
I20260807 06:43:57.375345 27272 ts_manager.cc:194] Registered new tserver with Master: 75442deef856435d8f48576e5d06c74b (127.11.137.131:46775)
I20260807 06:43:57.377532 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 27834
I20260807 06:43:57.377614 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:57.377787 11814 external_mini_cluster.cc:1428] Setting key 417b47988af62ab6829aff53a2c1771b
I20260807 06:43:57.378656 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:43:57.380342 27375 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:43:57.379914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51116 (local address 127.11.137.190:40141)
0807 06:43:57.379964 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:57.379966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:57.380098 (+ 132us) server_negotiation.cc:407] Connection header received
0807 06:43:57.380146 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:57.380147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:57.380151 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:57.380219 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:57.380304 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51116: BlockingRecv error: recv got EOF from 127.0.0.1:51116 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 06:43:57.380471 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 27390
I20260807 06:43:57.398360 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 27604
I20260807 06:43:57.410166 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 27834
I20260807 06:43:57.415635 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 27226
2026-08-07T06:43:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (571 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:57 dist-test-slave-8hhm krb5kdc[28085](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:57 dist-test-slave-8hhm krb5kdc[28085](info): set up 2 sockets
Aug 07 06:43:57 dist-test-slave-8hhm krb5kdc[28085](info): commencing operation
krb5kdc: starting...
W20260807 06:43:58.714702 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:43:58 dist-test-slave-8hhm krb5kdc[28085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:43:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:43:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:43:58.838384 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45899
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:45899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:58.922945 28106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:58.923139 28106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:58.923161 28106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:58.924214 28106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:43:58.924248 28106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:58.924263 28106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:58.924276 28106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:43:58.924288 28106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:43:58.925714 28106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:45899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:58.925895 28106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:58.926065 28106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:58.931039 28117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:58.931033 28106 server_base.cc:1034] running on GCE node
W20260807 06:43:58.930998 28116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:58.930999 28119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:58.931532 28106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:58.931836 28106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:58.932977 28106 hybrid_clock.cc:648] HybridClock initialized: now 1786085038932968 us; error 32 us; skew 500 ppm
Aug 07 06:43:58 dist-test-slave-8hhm krb5kdc[28085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085038, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:58.935487 28106 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:43:58.935914 28106 webserver.cc:460] Webserver started at http://127.11.137.190:45307/ using document root <none> and password file <none>
I20260807 06:43:58.936141 28106 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:58.936187 28106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:58.936333 28106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:58.937445 28106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "a8224d3b7332416ba6e9b1d7235ccbcb"
format_stamp: "Formatted at 2026-08-07 06:43:58 on dist-test-slave-8hhm"
server_key: "32e96f1a814379d88261dcae98e27cdb"
server_key_iv: "c2fd9b99f4a13f2193a8bb3e1f1e9ecd"
server_key_version: "encryptionkey@0"
I20260807 06:43:58.937808 28106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "a8224d3b7332416ba6e9b1d7235ccbcb"
format_stamp: "Formatted at 2026-08-07 06:43:58 on dist-test-slave-8hhm"
server_key: "32e96f1a814379d88261dcae98e27cdb"
server_key_iv: "c2fd9b99f4a13f2193a8bb3e1f1e9ecd"
server_key_version: "encryptionkey@0"
I20260807 06:43:58.939141 28106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:58.939882 28131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:58.940083 28106 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:58.940196 28106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "a8224d3b7332416ba6e9b1d7235ccbcb"
format_stamp: "Formatted at 2026-08-07 06:43:58 on dist-test-slave-8hhm"
server_key: "32e96f1a814379d88261dcae98e27cdb"
server_key_iv: "c2fd9b99f4a13f2193a8bb3e1f1e9ecd"
server_key_version: "encryptionkey@0"
I20260807 06:43:58.940284 28106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:58.955204 28106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:58.956995 28106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:58.957155 28106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:58.961440 28106 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:45899
I20260807 06:43:58.961474 28234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:45899 every 8 connection(s)
I20260807 06:43:58.961822 28106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:43:58.962831 28237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:58.963157 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 28106
I20260807 06:43:58.963232 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:43:58.963438 11814 external_mini_cluster.cc:1428] Setting key 18c34530ab6953f2a84bf684b2c856f1
I20260807 06:43:58.965592 28237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb: Bootstrap starting.
I20260807 06:43:58.966207 28237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:58.966508 28237 log.cc:824] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:58.967201 28237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb: No bootstrap required, opened a new log
I20260807 06:43:58.969323 28237 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45899 } }
I20260807 06:43:58.969511 28237 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:58.969547 28237 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8224d3b7332416ba6e9b1d7235ccbcb, State: Initialized, Role: FOLLOWER
I20260807 06:43:58.969687 28237 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45899 } }
I20260807 06:43:58.969790 28237 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:43:58.969830 28237 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:43:58.969878 28237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 0 FOLLOWER]: Advancing to term 1
Aug 07 06:43:58 dist-test-slave-8hhm krb5kdc[28085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:58.970458 28237 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45899 } }
I20260807 06:43:58.970579 28237 leader_election.cc:302] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8224d3b7332416ba6e9b1d7235ccbcb; no voters:
I20260807 06:43:58.970791 28237 leader_election.cc:288] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:43:58.970851 28243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:58.971052 28237 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:43:58.971426 28243 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [term 1 LEADER]: Becoming Leader. State: Replica: a8224d3b7332416ba6e9b1d7235ccbcb, State: Running, Role: LEADER
I20260807 06:43:58.972378 28243 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45899 } }
I20260807 06:43:58.973037 28244 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45899 } } }
I20260807 06:43:58.973126 28244 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:58.973338 28246 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8224d3b7332416ba6e9b1d7235ccbcb. Latest consensus state: current_term: 1 leader_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8224d3b7332416ba6e9b1d7235ccbcb" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45899 } } }
I20260807 06:43:58.973590 28268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:43:58.973608 28246 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb [sys.catalog]: This master's current role is: LEADER
I20260807 06:43:58.974099 28268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:43:58.974324 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:58.963996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37540 (local address 127.11.137.190:45899)
0807 06:43:58.964214 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:58.964227 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:58.964252 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:43:58.964681 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:58.964688 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:58.964731 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:58.964881 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:58.965566 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:58.966563 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:58.967317 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:58.967729 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:58.967849 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:58.970403 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:58.970407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:58.970407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:58.970419 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:58.972225 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:58.972640 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:58.972643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:58.972643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:58.972760 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:58.973011 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:58.973012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:58.973013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:58.973377 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:58.973533 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:58.973979 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 06:43:58.974113 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260807 06:43:58.975591 28268 catalog_manager.cc:1347] Generated new cluster ID: 47dd3b5d40d64bfd8ce466ff31ba08df
I20260807 06:43:58.975646 28268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:43:58.983311 28268 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:43:58.984042 28268 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:43:58.991291 28268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb: Generated new TSK 0
I20260807 06:43:58.991484 28268 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:43:59.026405 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45899
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:59.126209 28282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:59.126400 28282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:59.126422 28282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:59.127688 28282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:59.127732 28282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:59.127759 28282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:43:59.129292 28282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:59.129554 28282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:59.129782 28282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:59.134974 28293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:59.134981 28299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:59.135015 28290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:59.135313 28282 server_base.cc:1034] running on GCE node
I20260807 06:43:59.135468 28282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:59.135670 28282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:59.136806 28282 hybrid_clock.cc:648] HybridClock initialized: now 1786085039136793 us; error 28 us; skew 500 ppm
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[28085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085039, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:59.139264 28282 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:43:59.139714 28282 webserver.cc:460] Webserver started at http://127.11.137.129:38669/ using document root <none> and password file <none>
I20260807 06:43:59.139904 28282 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:59.139945 28282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:59.140033 28282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:59.141148 28282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "f1436b2f66e34afb8a7c9c9d1a51403d"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "a75568101ad925592fd9650ea5693a67"
server_key_iv: "d4fc600fb45620f60889c98e34537150"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.141534 28282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "f1436b2f66e34afb8a7c9c9d1a51403d"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "a75568101ad925592fd9650ea5693a67"
server_key_iv: "d4fc600fb45620f60889c98e34537150"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.142926 28282 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:59.143678 28310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.143867 28282 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:59.143966 28282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "f1436b2f66e34afb8a7c9c9d1a51403d"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "a75568101ad925592fd9650ea5693a67"
server_key_iv: "d4fc600fb45620f60889c98e34537150"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.144062 28282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:59.158313 28282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:59.160169 28282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:59.160328 28282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:59.160557 28282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:59.160908 28282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:59.160964 28282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.161028 28282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:59.161059 28282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.167076 28282 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:38305
I20260807 06:43:59.167174 28496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:38305 every 8 connection(s)
I20260807 06:43:59.167484 28282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:43:59.171990 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 28282
I20260807 06:43:59.172115 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:43:59.172322 11814 external_mini_cluster.cc:1428] Setting key 8d7f423a30f30f7305f34f248f43104d
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[28085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085039, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:59.177785 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.168254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:59799 (local address 127.11.137.190:45899)
0807 06:43:59.168297 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.168299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.168503 (+ 204us) server_negotiation.cc:407] Connection header received
0807 06:43:59.169014 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.169015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.169025 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.169088 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:59.170111 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.170635 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.171660 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.171980 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.172062 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.174705 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:59.174707 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:59.174707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:59.174715 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:59.176254 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.176680 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.176681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.176681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.176763 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.177032 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.177033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.177033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.177200 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:59.177301 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.177587 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.177692 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:43:59.177956 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.168208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45899 (local address 127.11.137.129:59799)
0807 06:43:59.168369 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.168411 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.168927 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.169164 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.169167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.169812 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:59.170005 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.170010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.170720 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.170721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.171587 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.171590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.172102 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.172103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.172265 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.172972 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:59.172982 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:59.174603 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:59.176356 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:59.176364 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:59.176366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:59.176600 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:59.176849 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:59.176850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:59.176850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:59.176965 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:59.177293 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:59.177301 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:59.177444 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.177552 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.177718 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260807 06:43:59.178660 28497 heartbeater.cc:347] Connected to a master server at 127.11.137.190:45899
I20260807 06:43:59.178745 28497 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:59.178938 28497 heartbeater.cc:511] Master 127.11.137.190:45899 requested a full tablet report, sending...
I20260807 06:43:59.179508 28164 ts_manager.cc:194] Registered new tserver with Master: f1436b2f66e34afb8a7c9c9d1a51403d (127.11.137.129:38305)
I20260807 06:43:59.180173 28164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:59799
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:43:59.198334 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45899
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:59.280272 28507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:59.280448 28507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:59.280469 28507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:59.281634 28507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:59.281692 28507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:59.281718 28507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:43:59.283131 28507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:59.283368 28507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:59.283581 28507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:59.288535 28519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:59.288527 28520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:59.288757 28507 server_base.cc:1034] running on GCE node
W20260807 06:43:59.288527 28522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:59.289031 28507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:59.289328 28507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:59.290495 28507 hybrid_clock.cc:648] HybridClock initialized: now 1786085039290470 us; error 49 us; skew 500 ppm
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[28085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085039, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:59.293004 28507 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:43:59.293498 28507 webserver.cc:460] Webserver started at http://127.11.137.130:39833/ using document root <none> and password file <none>
I20260807 06:43:59.293752 28507 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:59.293825 28507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:59.293975 28507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:59.295029 28507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "ec926c61fa594a8d85f84b6fc6f51975"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "91ce02394592da0adcd6293976764932"
server_key_iv: "d757a552711efcb2d9dfd44ee2997793"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.295403 28507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "ec926c61fa594a8d85f84b6fc6f51975"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "91ce02394592da0adcd6293976764932"
server_key_iv: "d757a552711efcb2d9dfd44ee2997793"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.296736 28507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:43:59.297515 28533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.297696 28507 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:43:59.297806 28507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "ec926c61fa594a8d85f84b6fc6f51975"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "91ce02394592da0adcd6293976764932"
server_key_iv: "d757a552711efcb2d9dfd44ee2997793"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.297883 28507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:59.308328 28507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:59.310164 28507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:59.310325 28507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:59.310539 28507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:59.310845 28507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:59.310902 28507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.310943 28507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:59.310971 28507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.316949 28507 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:38635
I20260807 06:43:59.316998 28726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:38635 every 8 connection(s)
I20260807 06:43:59.317420 28507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:43:59.322870 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 28507
I20260807 06:43:59.322993 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[28085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085039, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:59.323256 11814 external_mini_cluster.cc:1428] Setting key bbe428136fb8f020f6fc03135c5c6318
I20260807 06:43:59.326802 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.318156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:54205 (local address 127.11.137.190:45899)
0807 06:43:59.318240 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.318242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.318363 (+ 121us) server_negotiation.cc:407] Connection header received
0807 06:43:59.318823 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.318824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.318834 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.318886 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:59.319779 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.320269 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.321200 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.321395 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.321446 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.323704 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:59.323705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:59.323705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:59.323713 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:59.325266 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.325820 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.325822 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.325822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.325878 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.326172 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.326172 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.326173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.326274 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:59.326325 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.326668 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.326738 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:43:59.327101 28731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.318090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45899 (local address 127.11.137.130:54205)
0807 06:43:59.318233 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.318277 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.318741 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.318940 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.318943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.319513 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:59.319701 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.319707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.320351 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.320352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.321125 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.321127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.321467 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.321468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.321572 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.322122 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:59.322130 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:59.323606 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:59.325385 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:59.325393 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:59.325395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:59.325708 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:59.325949 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:59.325950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:59.325950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:59.326103 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:59.326341 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:59.326347 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:59.326530 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.326649 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.326838 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260807 06:43:59.327543 28729 heartbeater.cc:347] Connected to a master server at 127.11.137.190:45899
I20260807 06:43:59.327657 28729 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:59.327862 28729 heartbeater.cc:511] Master 127.11.137.190:45899 requested a full tablet report, sending...
I20260807 06:43:59.328248 28164 ts_manager.cc:194] Registered new tserver with Master: ec926c61fa594a8d85f84b6fc6f51975 (127.11.137.130:38635)
I20260807 06:43:59.328562 28164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:54205
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:43:59.349511 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45899
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:43:59.431221 28736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:43:59.431417 28736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:43:59.431440 28736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:43:59.432605 28736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:43:59.432648 28736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:43:59.432675 28736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:43:59.434254 28736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:43:59.434506 28736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:43:59.434762 28736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:43:59.439785 28749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:43:59.439847 28747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:59.439934 28736 server_base.cc:1034] running on GCE node
W20260807 06:43:59.439857 28746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:43:59.440289 28736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:43:59.440510 28736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:43:59.441689 28736 hybrid_clock.cc:648] HybridClock initialized: now 1786085039441664 us; error 46 us; skew 500 ppm
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[28085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085039, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:43:59.444386 28736 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:43:59.444779 28736 webserver.cc:460] Webserver started at http://127.11.137.131:35331/ using document root <none> and password file <none>
I20260807 06:43:59.445001 28736 fs_manager.cc:359] Metadata directory not provided
I20260807 06:43:59.445042 28736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:43:59.445129 28736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:43:59.446204 28736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "bb86bab4f231481dab4f0f4b66f6ac11"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "3e197351e051cc306dc5840367ef21ca"
server_key_iv: "235a4cb07d105676b46685ca52a3362e"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.446506 28736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "bb86bab4f231481dab4f0f4b66f6ac11"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "3e197351e051cc306dc5840367ef21ca"
server_key_iv: "235a4cb07d105676b46685ca52a3362e"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.447816 28736 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:43:59.448503 28758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.448701 28736 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:43:59.448807 28736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "bb86bab4f231481dab4f0f4b66f6ac11"
format_stamp: "Formatted at 2026-08-07 06:43:59 on dist-test-slave-8hhm"
server_key: "3e197351e051cc306dc5840367ef21ca"
server_key_iv: "235a4cb07d105676b46685ca52a3362e"
server_key_version: "encryptionkey@0"
I20260807 06:43:59.448884 28736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:43:59.460789 28736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:43:59.463052 28736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:43:59.463215 28736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:43:59.463428 28736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:43:59.463737 28736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:43:59.463773 28736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.463811 28736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:43:59.463840 28736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:43:59.469488 28736 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:34599
I20260807 06:43:59.469559 28944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:34599 every 8 connection(s)
I20260807 06:43:59.469897 28736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:43:59.474395 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 28736
I20260807 06:43:59.474498 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:43:59.474702 11814 external_mini_cluster.cc:1428] Setting key 1433597bca7be61a47efae294dc50be0
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[28085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085039, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:43:59.479493 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.470622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:42847 (local address 127.11.137.190:45899)
0807 06:43:59.470667 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.470668 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.470983 (+ 315us) server_negotiation.cc:407] Connection header received
0807 06:43:59.471524 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.471525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.471540 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.471617 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:59.472659 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.473167 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.474600 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.474889 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.474987 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.477150 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:59.477152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:59.477152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:59.477159 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:59.478381 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.478747 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.478748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.478748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.478797 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.479002 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.479003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.479003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.479110 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:59.479160 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.479373 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.479433 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:43:59.479643 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.470607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45899 (local address 127.11.137.131:42847)
0807 06:43:59.470801 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.470881 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.471388 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.471720 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.471726 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.472348 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:43:59.472552 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.472559 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.473345 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.473346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.474467 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.474470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.475016 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.475017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.475154 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.475645 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:43:59.475661 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:43:59.477070 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:43:59.478449 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:59.478455 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:59.478457 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:59.478670 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:59.478855 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:43:59.478856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:43:59.478856 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:43:59.478950 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:43:59.479162 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:43:59.479166 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:43:59.479270 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.479348 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.479459 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":112,"threads_started":1}
I20260807 06:43:59.480156 28945 heartbeater.cc:347] Connected to a master server at 127.11.137.190:45899
I20260807 06:43:59.480263 28945 heartbeater.cc:464] Registering TS with master...
I20260807 06:43:59.480443 28945 heartbeater.cc:511] Master 127.11.137.190:45899 requested a full tablet report, sending...
I20260807 06:43:59.480858 28164 ts_manager.cc:194] Registered new tserver with Master: bb86bab4f231481dab4f0f4b66f6ac11 (127.11.137.131:34599)
I20260807 06:43:59.481280 28164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:42847
I20260807 06:43:59.486315 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:43:59.493268 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.487542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37554 (local address 127.11.137.190:45899)
0807 06:43:59.487599 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.487601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.487744 (+ 143us) server_negotiation.cc:407] Connection header received
0807 06:43:59.487779 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.487780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.487788 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.487834 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:43:59.488337 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.488790 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.489513 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.489687 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.489740 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.490849 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:43:59.490850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:43:59.490851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:43:59.490856 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:43:59.492267 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.492565 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.492565 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.492566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.492616 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:43:59.492780 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:43:59.492781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:43:59.492781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:43:59.492904 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:43:59.492979 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.493063 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.493130 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:43:59.494920 28164 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:43:59.496459 28164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:43:59.503037 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.498826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:34599 (local address 127.0.0.1:33048)
0807 06:43:59.498919 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.498954 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.499020 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.499473 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.499476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.499481 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:59.499561 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.499563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.500752 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.500753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.502072 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.502074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.502762 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.502840 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.502852 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.502918 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.502968 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":27,"thread_start_us":50,"threads_started":1}
I20260807 06:43:59.503059 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.498974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.11.137.131:34599)
0807 06:43:59.499291 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.499294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.499304 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:43:59.499343 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.499345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.499361 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.499454 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:59.499630 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.500650 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502161 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.502658 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502761 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.502817 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.502939 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.502991 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":86,"threads_started":1}
I20260807 06:43:59.503252 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.498837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38635 (local address 127.0.0.1:45612)
0807 06:43:59.499133 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.499142 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.499222 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.499474 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.499476 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.499478 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:59.499544 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.499547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.500862 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.500863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.502057 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.502060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.503005 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.503006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.503070 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.503084 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.503126 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.503169 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":9,"thread_start_us":88,"threads_started":1}
I20260807 06:43:59.503531 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.498872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:38305 (local address 127.0.0.1:50526)
0807 06:43:59.499548 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.499558 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.499719 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.499978 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.499978 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.499980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:59.500028 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.500030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.501203 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.501204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.502176 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.502185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.503024 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.503025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.503074 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.503079 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.503424 (+ 345us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.503471 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":2,"thread_start_us":63,"threads_started":1}
I20260807 06:43:59.503580 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.499078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50526 (local address 127.11.137.129:38305)
0807 06:43:59.499276 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.499281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.499685 (+ 404us) server_negotiation.cc:407] Connection header received
0807 06:43:59.499814 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.499816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.499832 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.499899 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:59.500109 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.501094 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502263 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.502899 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502956 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.502998 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.503448 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.503496 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260807 06:43:59.503631 28968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.499092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45612 (local address 127.11.137.130:38635)
0807 06:43:59.499286 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.499291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.499303 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:43:59.499344 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.499346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.499361 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.499454 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:59.499645 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.500755 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502174 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.502842 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.502913 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.502969 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.503499 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.503543 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":81,"threads_started":1}
I20260807 06:43:59.503955 28848 tablet_service.cc:1467] Processing CreateTablet for tablet cdb3b9fff6e84719a88ab2d91cb3d603 (DEFAULT_TABLE table=test-table [id=6402f12fd74847719067216aabd6ed6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:59.504325 28848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb3b9fff6e84719a88ab2d91cb3d603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:59.504244 28625 tablet_service.cc:1467] Processing CreateTablet for tablet cdb3b9fff6e84719a88ab2d91cb3d603 (DEFAULT_TABLE table=test-table [id=6402f12fd74847719067216aabd6ed6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:59.504551 28625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb3b9fff6e84719a88ab2d91cb3d603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:59.504504 28391 tablet_service.cc:1467] Processing CreateTablet for tablet cdb3b9fff6e84719a88ab2d91cb3d603 (DEFAULT_TABLE table=test-table [id=6402f12fd74847719067216aabd6ed6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:43:59.504738 28391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb3b9fff6e84719a88ab2d91cb3d603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:43:59.507438 28970 tablet_bootstrap.cc:492] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d: Bootstrap starting.
I20260807 06:43:59.507643 28972 tablet_bootstrap.cc:492] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Bootstrap starting.
I20260807 06:43:59.508208 28970 tablet_bootstrap.cc:654] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:59.508255 28972 tablet_bootstrap.cc:654] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:59.508852 28970 log.cc:824] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:59.508899 28972 log.cc:824] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:59.509271 28973 tablet_bootstrap.cc:492] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Bootstrap starting.
I20260807 06:43:59.509642 28972 tablet_bootstrap.cc:492] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: No bootstrap required, opened a new log
I20260807 06:43:59.509734 28972 ts_tablet_manager.cc:1397] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:59.509757 28970 tablet_bootstrap.cc:492] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d: No bootstrap required, opened a new log
I20260807 06:43:59.509817 28970 ts_tablet_manager.cc:1397] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:43:59.509935 28973 tablet_bootstrap.cc:654] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Neither blocks nor log segments found. Creating new log.
I20260807 06:43:59.510521 28973 log.cc:824] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Log is configured to *not* fsync() on all Append() calls
I20260807 06:43:59.511322 28973 tablet_bootstrap.cc:492] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: No bootstrap required, opened a new log
I20260807 06:43:59.511390 28973 ts_tablet_manager.cc:1397] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:43:59.511420 28972 raft_consensus.cc:348] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.511597 28972 raft_consensus.cc:374] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:59.511636 28972 raft_consensus.cc:729] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb86bab4f231481dab4f0f4b66f6ac11, State: Initialized, Role: FOLLOWER
I20260807 06:43:59.511801 28972 consensus_queue.cc:260] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.511904 28970 raft_consensus.cc:348] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.512089 28970 raft_consensus.cc:374] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:59.512101 28972 ts_tablet_manager.cc:1428] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:43:59.512238 28945 heartbeater.cc:503] Master 127.11.137.190:45899 was elected leader, sending a full tablet report...
I20260807 06:43:59.512156 28970 raft_consensus.cc:729] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1436b2f66e34afb8a7c9c9d1a51403d, State: Initialized, Role: FOLLOWER
I20260807 06:43:59.512634 28970 consensus_queue.cc:260] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.512953 28970 ts_tablet_manager.cc:1428] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:43:59.513088 28497 heartbeater.cc:503] Master 127.11.137.190:45899 was elected leader, sending a full tablet report...
I20260807 06:43:59.513545 28973 raft_consensus.cc:348] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.513710 28973 raft_consensus.cc:374] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:43:59.513756 28973 raft_consensus.cc:729] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec926c61fa594a8d85f84b6fc6f51975, State: Initialized, Role: FOLLOWER
I20260807 06:43:59.513866 28973 consensus_queue.cc:260] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.514155 28729 heartbeater.cc:503] Master 127.11.137.190:45899 was elected leader, sending a full tablet report...
I20260807 06:43:59.514139 28973 ts_tablet_manager.cc:1428] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 06:43:59.548521 28982 raft_consensus.cc:482] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:43:59.548632 28982 raft_consensus.cc:504] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.549050 28982 leader_election.cc:288] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec926c61fa594a8d85f84b6fc6f51975 (127.11.137.130:38635), bb86bab4f231481dab4f0f4b66f6ac11 (127.11.137.131:34599)
I20260807 06:43:59.551957 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.549334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:42573 (local address 127.11.137.131:34599)
0807 06:43:59.549383 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.549385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.549394 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:59.549424 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.549425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.549436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.549505 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:59.549685 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.550163 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.551124 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.551588 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.551673 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.551681 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.551854 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.551890 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 06:43:59.551956 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.549256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:34599 (local address 127.11.137.129:42573)
0807 06:43:59.549294 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.549306 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.549349 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.549522 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.549524 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.549526 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:59.549598 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.549600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.550259 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.550260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.551008 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.551010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.551670 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.551671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.551765 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.551769 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.551845 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.551884 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260807 06:43:59.552201 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.549259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38635 (local address 127.11.137.129:60063)
0807 06:43:59.549508 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.549517 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:43:59.549596 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:43:59.549751 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:43:59.549751 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:43:59.549753 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:43:59.549829 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.549830 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.550451 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.550453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.551284 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:43:59.551287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.551896 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.551897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:43:59.551970 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.551979 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:43:59.552052 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:43:59.552099 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":60,"thread_start_us":136,"threads_started":1}
I20260807 06:43:59.552306 28968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.549367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:60063 (local address 127.11.137.130:38635)
0807 06:43:59.549423 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.549425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.549579 (+ 154us) server_negotiation.cc:407] Connection header received
0807 06:43:59.549662 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.549663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.549677 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.549746 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:43:59.549898 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.550364 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.551374 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.551808 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.551895 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.551903 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.552179 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.552226 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:43:59.552310 28875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb3b9fff6e84719a88ab2d91cb3d603" candidate_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" is_pre_election: true
I20260807 06:43:59.552474 28875 raft_consensus.cc:2454] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1436b2f66e34afb8a7c9c9d1a51403d in term 0.
I20260807 06:43:59.552703 28312 leader_election.cc:302] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb86bab4f231481dab4f0f4b66f6ac11, f1436b2f66e34afb8a7c9c9d1a51403d; no voters:
I20260807 06:43:59.552750 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb3b9fff6e84719a88ab2d91cb3d603" candidate_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec926c61fa594a8d85f84b6fc6f51975" is_pre_election: true
I20260807 06:43:59.552827 28982 raft_consensus.cc:2781] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:43:59.552889 28982 raft_consensus.cc:482] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:43:59.552922 28982 raft_consensus.cc:3037] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:59.552910 28656 raft_consensus.cc:2454] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1436b2f66e34afb8a7c9c9d1a51403d in term 0.
I20260807 06:43:59.553758 28982 raft_consensus.cc:504] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.553905 28982 leader_election.cc:288] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [CANDIDATE]: Term 1 election: Requested vote from peers ec926c61fa594a8d85f84b6fc6f51975 (127.11.137.130:38635), bb86bab4f231481dab4f0f4b66f6ac11 (127.11.137.131:34599)
I20260807 06:43:59.554059 28875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb3b9fff6e84719a88ab2d91cb3d603" candidate_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb86bab4f231481dab4f0f4b66f6ac11"
I20260807 06:43:59.554131 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb3b9fff6e84719a88ab2d91cb3d603" candidate_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec926c61fa594a8d85f84b6fc6f51975"
I20260807 06:43:59.554148 28875 raft_consensus.cc:3037] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:59.554215 28656 raft_consensus.cc:3037] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:43:59.554865 28875 raft_consensus.cc:2454] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1436b2f66e34afb8a7c9c9d1a51403d in term 1.
I20260807 06:43:59.555034 28656 raft_consensus.cc:2454] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1436b2f66e34afb8a7c9c9d1a51403d in term 1.
I20260807 06:43:59.555070 28312 leader_election.cc:302] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb86bab4f231481dab4f0f4b66f6ac11, f1436b2f66e34afb8a7c9c9d1a51403d; no voters:
I20260807 06:43:59.555195 28982 raft_consensus.cc:2781] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:43:59.555351 28982 raft_consensus.cc:686] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [term 1 LEADER]: Becoming Leader. State: Replica: f1436b2f66e34afb8a7c9c9d1a51403d, State: Running, Role: LEADER
I20260807 06:43:59.555456 28982 consensus_queue.cc:237] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } }
I20260807 06:43:59.556349 28164 catalog_manager.cc:5495] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d reported cstate change: term changed from 0 to 1, leader changed from <none> to f1436b2f66e34afb8a7c9c9d1a51403d (127.11.137.129). New cstate: current_term: 1 leader_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1436b2f66e34afb8a7c9c9d1a51403d" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 38305 } health_report { overall_health: HEALTHY } } }
I20260807 06:43:59.561506 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.559143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50540 (local address 127.11.137.129:38305)
0807 06:43:59.559199 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 06:43:59.559201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:43:59.559210 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:43:59.559239 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:43:59.559240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:43:59.559257 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:43:59.559342 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:43:59.559487 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.559919 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.560675 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:43:59.560883 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:43:59.560959 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:43:59.561133 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:43:59.561281 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:43:59.561380 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 06:43:59.561400 (+ 20us) server_negotiation.cc:299] Negotiation successful
0807 06:43:59.561419 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:43:59.563148 28875 raft_consensus.cc:1261] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 1 FOLLOWER]: Refusing update from remote peer f1436b2f66e34afb8a7c9c9d1a51403d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:59.563148 28656 raft_consensus.cc:1261] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 1 FOLLOWER]: Refusing update from remote peer f1436b2f66e34afb8a7c9c9d1a51403d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:43:59.563463 28986 consensus_queue.cc:1035] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec926c61fa594a8d85f84b6fc6f51975" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:59.563580 28982 consensus_queue.cc:1035] T cdb3b9fff6e84719a88ab2d91cb3d603 P f1436b2f66e34afb8a7c9c9d1a51403d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb86bab4f231481dab4f0f4b66f6ac11" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:43:59.566064 28991 mvcc.cc:205] Tried to move back new op lower bound from 7315804322047864832 to 7315804322019852288. Current Snapshot: MvccSnapshot[applied={T|T < 7315804322047864832}]
I20260807 06:43:59.566202 28993 mvcc.cc:205] Tried to move back new op lower bound from 7315804322047864832 to 7315804322019852288. Current Snapshot: MvccSnapshot[applied={T|T < 7315804322047864832}]
I20260807 06:43:59.568663 28164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:59.568769 28164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:43:59.569465 28164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a8224d3b7332416ba6e9b1d7235ccbcb: Sending DeleteTablet for 3 replicas of tablet cdb3b9fff6e84719a88ab2d91cb3d603
I20260807 06:43:59.569790 28848 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb3b9fff6e84719a88ab2d91cb3d603 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:59 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:33048
I20260807 06:43:59.569855 28391 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb3b9fff6e84719a88ab2d91cb3d603 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:59 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:50526
I20260807 06:43:59.569871 28625 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb3b9fff6e84719a88ab2d91cb3d603 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:43:59 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:45612
I20260807 06:43:59.570091 29011 tablet_replica.cc:330] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: stopping tablet replica
I20260807 06:43:59.570091 29013 tablet_replica.cc:330] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: stopping tablet replica
I20260807 06:43:59.570215 29013 raft_consensus.cc:2229] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:59.570326 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 28282
I20260807 06:43:59.570276 29011 raft_consensus.cc:2229] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:43:59.576668 29011 raft_consensus.cc:2258] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:59.576725 29013 raft_consensus.cc:2258] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:43:59.577276 29011 ts_tablet_manager.cc:1905] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:59.579282 29011 ts_tablet_manager.cc:1918] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:59.579367 29011 log.cc:1196] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/cdb3b9fff6e84719a88ab2d91cb3d603
I20260807 06:43:59.579734 29011 ts_tablet_manager.cc:1939] T cdb3b9fff6e84719a88ab2d91cb3d603 P bb86bab4f231481dab4f0f4b66f6ac11: Deleting consensus metadata
I20260807 06:43:59.580250 28134 catalog_manager.cc:4841] TS bb86bab4f231481dab4f0f4b66f6ac11 (127.11.137.131:34599): tablet cdb3b9fff6e84719a88ab2d91cb3d603 (table test-table [id=6402f12fd74847719067216aabd6ed6a]) successfully deleted
I20260807 06:43:59.585541 29013 ts_tablet_manager.cc:1905] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:43:59.587436 29013 ts_tablet_manager.cc:1918] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:43:59.587504 29013 log.cc:1196] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/cdb3b9fff6e84719a88ab2d91cb3d603
I20260807 06:43:59.587811 29013 ts_tablet_manager.cc:1939] T cdb3b9fff6e84719a88ab2d91cb3d603 P ec926c61fa594a8d85f84b6fc6f51975: Deleting consensus metadata
I20260807 06:43:59.588235 28133 catalog_manager.cc:4841] TS ec926c61fa594a8d85f84b6fc6f51975 (127.11.137.130:38635): tablet cdb3b9fff6e84719a88ab2d91cb3d603 (table test-table [id=6402f12fd74847719067216aabd6ed6a]) successfully deleted
W20260807 06:43:59.591034 28138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:38305 (error 108)
I20260807 06:43:59.591253 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 28507
I20260807 06:43:59.595150 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:43:59.594094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:38305 (local address 127.0.0.1:50544)
0807 06:43:59.595051 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0807 06:43:59.595104 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:38305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":929}
W20260807 06:43:59.596436 28138 catalog_manager.cc:4584] TS f1436b2f66e34afb8a7c9c9d1a51403d (127.11.137.129:38305): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cdb3b9fff6e84719a88ab2d91cb3d603: Network error: Client connection negotiation failed: client connection to 127.11.137.129:38305: connect: Connection refused (error 111)
I20260807 06:43:59.600309 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 28736
I20260807 06:43:59.632126 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 28106
2026-08-07T06:43:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2215 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[29019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[29019](info): set up 2 sockets
Aug 07 06:43:59 dist-test-slave-8hhm krb5kdc[29019](info): commencing operation
krb5kdc: starting...
W20260807 06:44:00.906901 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:44:00 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:44:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:44:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/rangeradmin_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/rangeradmin_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/rangerlookup_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/rangerlookup_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
I20260807 06:44:01.077459 11814 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBunj0a/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/postgres -l logfile start
2026-08-07 06:44:03.545 UTC [29077] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 06:44:03.545 UTC [29077] LOG: listening on IPv4 address "127.11.137.148", port 41777
2026-08-07 06:44:03.548 UTC [29077] LOG: listening on Unix socket "/tmp/.s.PGSQL.41777"
2026-08-07 06:44:03.570 UTC [29083] LOG: database system was shut down at 2026-08-07 06:44:02 UTC
2026-08-07 06:44:03.573 UTC [29077] LOG: database system is ready to accept connections
I20260807 06:44:04.740088 11814 mini_postgres.cc:96] Postgres bound to 41777
2026-08-07 06:44:04.748 UTC [29093] FATAL: database "slave" does not exist
127.11.137.148:41777 - accepting connections
I20260807 06:44:04.749289 11814 mini_ranger.cc:161] Starting Ranger...
I20260807 06:44:04.765055 11814 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 06:44:05.209493 11814 mini_ranger.cc:87] Created ranger Postgres database
I20260807 06:44:05.209563 11814 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-admin
2026-08-07 06:44:05,540 [I] DB FLAVOR :POSTGRES
2026-08-07 06:44:05,541 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:44:05,541 [I] Checking connection..
2026-08-07 06:44:05,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 06:44:05,814 [I] Checking connection passed.
2026-08-07 06:44:05,815 [I] --------- Verifying version history table ---------
2026-08-07 06:44:05,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:44:06,084 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:44:06,084 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:44:06,371 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:44:06,372 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 06:44:06,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 06:44:06.615 UTC [29203] WARNING: there is no transaction in progress
2026-08-07 06:44:06,623 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 06:44:06,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:44:06,871 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 06:44:06,872 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:44:06,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 06:44:07,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 06:44:07,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8hhm.c.gcp-upstream.internal','N') ;"
2026-08-07 06:44:07,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:44:07,840 [I] Table x_portal_user does not exist in database ranger
2026-08-07 06:44:07,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:44:08,086 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 06:44:08,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:44:08,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:44:08,619 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 06:44:08,620 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 06:44:09.576 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.592 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.608 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.623 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.639 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.659 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.712 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.718 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.732 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.742 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.751 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.765 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.774 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.780 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.787 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:09.794 UTC [29391] WARNING: there is no transaction in progress
2026-08-07 06:44:10,418 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 06:44:10,419 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 06:44:10,663 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 06:44:10,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:44:10,928 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 06:44:10,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:44:11,193 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 06:44:11,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:44:11,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:44:11,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8hhm.c.gcp-upstream.internal';"
2026-08-07 06:44:11,975 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 06:44:11,975 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 06:44:12,229 [I] DB_PATCHES have already been applied
I20260807 06:44:12.234972 11814 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBunj0a/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 06:44:12.235038 11814 mini_ranger.cc:193] Using host: 127.11.137.148
I20260807 06:44:12.238840 11814 mini_ranger.cc:227] Ranger admin URL: http://127.11.137.148:58831
Aug 07, 2026 6:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:44:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:44:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 06:44:13.662540 11814 mini_ranger.cc:160] Time spent starting Ranger: real 8.913s user 0.005s sys 0.005s
Aug 07, 2026 6:44:33 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:44:33 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 6:44:33 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:44:33 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:44:34 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 06:44:35.437474 11814 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/rangerkms_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/rangerkms_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.137.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.137.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 06:44:35 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085075, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 06:44:35.527689 11814 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 06:44:35.539400 11814 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 06:44:36.345860 11814 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 06:44:36.345947 11814 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms
I20260807 06:44:36.345968 11814 mini_ranger_kms.cc:227] Using postgres at 127.11.137.148:41777
2026-08-07 06:44:36,920 [I] DB FLAVOR :POSTGRES
2026-08-07 06:44:36,921 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:44:36,921 [I] Checking connection
2026-08-07 06:44:36,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 06:44:37,267 [I] connection success
2026-08-07 06:44:37,267 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 06:44:37,267 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 06:44:37,267 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 06:44:37,507 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 06:44:37,507 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:44:37,507 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 06:44:37,508 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:41777/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 06:44:37,795 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 06:44:38.227231 11814 mini_ranger_kms.cc:310] Created kms service
I20260807 06:44:38.401173 11814 mini_ranger_kms.cc:326] Created kudu user
I20260807 06:44:38.443995 11814 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 06:44:38 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085075, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:44:38.872227 11814 mini_ranger_kms.cc:384] Added ranger policy
I20260807 06:44:38.872347 11814 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 06:44:38.872367 11814 mini_ranger_kms.cc:240] Using host: 127.11.137.148
I20260807 06:44:38.877064 11814 mini_ranger_kms.cc:276] Ranger KMS PID: 29672
I20260807 06:44:38.877199 11814 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.137.148:35781
Aug 07, 2026 6:44:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:44:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:44:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:44:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:44:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:44:40 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 06:44:42 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085082, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.137.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:44:42.528193 11814 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.001s user 0.000s sys 0.427s
I20260807 06:44:42.528312 11814 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 06:44:42.528406 11814 mini_ranger_kms.cc:401] 127.11.137.148:35781/kms/v1/keys
Aug 07 06:44:42 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085082, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.137.148@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
Aug 07 06:44:43 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085082, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.137.148@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
Aug 07 06:44:45 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:44:45.556592 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:35019
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:35019
--ranger_config_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:35781/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:44:45.660323 29755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:44:45.660549 29755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:44:45.660573 29755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:44:45.661856 29755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:44:45.661942 29755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:44:45.661983 29755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:44:45.662037 29755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:44:45.662060 29755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:44:45.663815 29755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.137.148:35781/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:35019
--ranger_config_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:35019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:44:45.664098 29755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:44:45.664362 29755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:44:45.670984 29762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:45.671042 29763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:45.671097 29767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:44:45.671572 29755 server_base.cc:1034] running on GCE node
I20260807 06:44:45.671880 29755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:44:45.672224 29755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:44:45.673398 29755 hybrid_clock.cc:648] HybridClock initialized: now 1786085085673369 us; error 44 us; skew 500 ppm
Aug 07 06:44:45 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085085, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:44:45.676502 29755 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:44:45.677048 29755 webserver.cc:460] Webserver started at http://127.11.137.190:36621/ using document root <none> and password file <none>
I20260807 06:44:45.677354 29755 fs_manager.cc:359] Metadata directory not provided
I20260807 06:44:45.677400 29755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:44:45.677537 29755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:44:45 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085085, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:44:45.741868 29755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "8c832996494f472a99c200c01dc2d5b6"
format_stamp: "Formatted at 2026-08-07 06:44:45 on dist-test-slave-8hhm"
server_key: "b507d25df56ebbbe0d74a53d18a5c12d"
server_key_iv: "e246186d89f95675d3266cbb9b80ac1f"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:45.742355 29755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "8c832996494f472a99c200c01dc2d5b6"
format_stamp: "Formatted at 2026-08-07 06:44:45 on dist-test-slave-8hhm"
server_key: "b507d25df56ebbbe0d74a53d18a5c12d"
server_key_iv: "e246186d89f95675d3266cbb9b80ac1f"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:45.744153 29755 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:44:45.760010 29778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:45.760262 29755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:44:45.760375 29755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "8c832996494f472a99c200c01dc2d5b6"
format_stamp: "Formatted at 2026-08-07 06:44:45 on dist-test-slave-8hhm"
server_key: "b507d25df56ebbbe0d74a53d18a5c12d"
server_key_iv: "e246186d89f95675d3266cbb9b80ac1f"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:45.760488 29755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:44:45.769361 29755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:44:45.771533 29755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:44:45.771796 29755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:44:45.780799 29755 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:35019
I20260807 06:44:45.780872 29859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:35019 every 8 connection(s)
I20260807 06:44:45.781297 29755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:44:45.782258 29861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:44:45.783869 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 29755
I20260807 06:44:45.784098 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:44:45.784406 11814 external_mini_cluster.cc:1428] Setting key 9f2df877df449194275e8f17328feb07
I20260807 06:44:45.786396 29861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6: Bootstrap starting.
I20260807 06:44:45.787321 29861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6: Neither blocks nor log segments found. Creating new log.
I20260807 06:44:45.787777 29861 log.cc:824] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6: Log is configured to *not* fsync() on all Append() calls
I20260807 06:44:45.788532 29861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6: No bootstrap required, opened a new log
I20260807 06:44:45.790766 29861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c832996494f472a99c200c01dc2d5b6" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35019 } }
I20260807 06:44:45.790936 29861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:44:45.791002 29861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c832996494f472a99c200c01dc2d5b6, State: Initialized, Role: FOLLOWER
I20260807 06:44:45.791180 29861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c832996494f472a99c200c01dc2d5b6" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35019 } }
I20260807 06:44:45.791280 29861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:44:45.791337 29861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:44:45.791411 29861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:44:45.792045 29861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c832996494f472a99c200c01dc2d5b6" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35019 } }
I20260807 06:44:45.792171 29861 leader_election.cc:302] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c832996494f472a99c200c01dc2d5b6; no voters:
I20260807 06:44:45.792366 29861 leader_election.cc:288] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:44:45.792397 29868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:44:45.792665 29868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [term 1 LEADER]: Becoming Leader. State: Replica: 8c832996494f472a99c200c01dc2d5b6, State: Running, Role: LEADER
I20260807 06:44:45.792775 29861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 06:44:45 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:44:45.794207 29868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c832996494f472a99c200c01dc2d5b6" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35019 } }
I20260807 06:44:45.795305 29871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c832996494f472a99c200c01dc2d5b6. Latest consensus state: current_term: 1 leader_uuid: "8c832996494f472a99c200c01dc2d5b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c832996494f472a99c200c01dc2d5b6" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35019 } } }
I20260807 06:44:45.795392 29871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [sys.catalog]: This master's current role is: LEADER
I20260807 06:44:45.796003 29861 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:44:45.796103 29872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c832996494f472a99c200c01dc2d5b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c832996494f472a99c200c01dc2d5b6" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35019 } } }
I20260807 06:44:45.796217 29872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6 [sys.catalog]: This master's current role is: LEADER
I20260807 06:44:45.796702 29896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:44:45.797261 29896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:44:45.798739 29866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:45.785075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41300 (local address 127.11.137.190:35019)
0807 06:44:45.785468 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:45.785491 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:45.785535 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:44:45.786377 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:45.786397 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:45.786464 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:45.786613 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:44:45.787479 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:45.788956 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:45.790238 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:45.790852 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:45.792861 (+ 2009us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:45.794175 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:44:45.794179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:44:45.794180 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:44:45.794192 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:44:45.796621 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:45.797079 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:45.797083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:45.797083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:45.797187 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:45.797457 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:45.797458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:45.797458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:45.797744 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:44:45.797890 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:45.798401 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 06:44:45.798526 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":106,"threads_started":1}
I20260807 06:44:45.804296 29896 catalog_manager.cc:1347] Generated new cluster ID: eb437a70ca9e447caf7a93d8d50562e4
I20260807 06:44:45.804368 29896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:44:45.811213 29896 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:44:45.812141 29896 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:44:45.826949 29896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6: Generated new TSK 0
I20260807 06:44:45.827278 29896 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:44:46.719514 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:35781/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35019
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:44:46.826459 29950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:44:46.826699 29950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:44:46.826740 29950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:44:46.828087 29950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:44:46.828166 29950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:44:46.828212 29950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:44:46.830039 29950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.137.148:35781/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35019
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:44:46.830272 29950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:44:46.830511 29950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:44:46.837690 29958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:46.837795 29956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:46.837865 29955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:44:46.838096 29950 server_base.cc:1034] running on GCE node
I20260807 06:44:46.838364 29950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:44:46.838735 29950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:44:46.840021 29950 hybrid_clock.cc:648] HybridClock initialized: now 1786085086839968 us; error 48 us; skew 500 ppm
Aug 07 06:44:46 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085086, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:44:46.843523 29950 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:44:46.844070 29950 webserver.cc:460] Webserver started at http://127.11.137.129:39769/ using document root <none> and password file <none>
I20260807 06:44:46.844393 29950 fs_manager.cc:359] Metadata directory not provided
I20260807 06:44:46.844475 29950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:44:46.844635 29950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:44:46 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085086, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:44:46.861349 29950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "93477ff29cbd45ff8e7c449c710893a5"
format_stamp: "Formatted at 2026-08-07 06:44:46 on dist-test-slave-8hhm"
server_key: "c23121b8f18154138b99d5557fac1470"
server_key_iv: "5d8c1c75ba9e4df1e7017590cc4f4fb6"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:46.862063 29950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "93477ff29cbd45ff8e7c449c710893a5"
format_stamp: "Formatted at 2026-08-07 06:44:46 on dist-test-slave-8hhm"
server_key: "c23121b8f18154138b99d5557fac1470"
server_key_iv: "5d8c1c75ba9e4df1e7017590cc4f4fb6"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:46.865116 29950 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 06:44:46.886891 29971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:46.888202 29950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260807 06:44:46.888598 29950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "93477ff29cbd45ff8e7c449c710893a5"
format_stamp: "Formatted at 2026-08-07 06:44:46 on dist-test-slave-8hhm"
server_key: "c23121b8f18154138b99d5557fac1470"
server_key_iv: "5d8c1c75ba9e4df1e7017590cc4f4fb6"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:46.888728 29950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:44:46.919914 29950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:44:46.922510 29950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:44:46.922667 29950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:44:46.922940 29950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:44:46.923538 29950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:44:46.923599 29950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:46.923630 29950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:44:46.923648 29950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:46.942653 29950 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:36771
I20260807 06:44:46.943477 29950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:44:46.942770 30165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:36771 every 8 connection(s)
I20260807 06:44:46.950388 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 29950
I20260807 06:44:46.950516 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:44:46.950786 11814 external_mini_cluster.cc:1428] Setting key e81b0b92dbab7e39a1b3ff7f55863e5a
Aug 07 06:44:46 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085086, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:44:46.962190 30173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:46.944610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35019 (local address 127.11.137.129:41205)
0807 06:44:46.950128 (+ 5518us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:46.950185 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:46.951112 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:46.951829 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:46.951834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:46.952209 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:44:46.952602 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:46.952610 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:46.953657 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:46.953658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:46.955141 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:46.955145 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:46.955683 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:46.955685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:46.955835 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:46.956493 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:44:46.956504 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:44:46.958350 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:44:46.960451 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:44:46.960458 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:44:46.960460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:44:46.960765 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:44:46.960989 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:44:46.960990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:44:46.960990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:44:46.961124 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:44:46.961468 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:44:46.961477 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:44:46.961677 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 06:44:46.961791 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:44:46.961948 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5470,"thread_start_us":195,"threads_started":1}
I20260807 06:44:46.962767 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:46.945024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:41205 (local address 127.11.137.190:35019)
0807 06:44:46.945167 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:46.945169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:46.950312 (+ 5143us) server_negotiation.cc:407] Connection header received
0807 06:44:46.951533 (+ 1221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:46.951534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:46.951547 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:46.951594 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:44:46.952722 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:46.953535 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:46.955253 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:46.955575 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:46.955658 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:46.958453 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:44:46.958455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:44:46.958455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:44:46.958463 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:44:46.960355 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:46.960856 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:46.960857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:46.960857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:46.960921 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:46.961201 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:46.961201 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:46.961202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:46.961369 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:44:46.961435 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:46.962573 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0807 06:44:46.962664 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:44:46.970315 30166 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35019
I20260807 06:44:46.970425 30166 heartbeater.cc:464] Registering TS with master...
I20260807 06:44:46.970638 30166 heartbeater.cc:511] Master 127.11.137.190:35019 requested a full tablet report, sending...
I20260807 06:44:46.971320 29804 ts_manager.cc:194] Registered new tserver with Master: 93477ff29cbd45ff8e7c449c710893a5 (127.11.137.129:36771)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
I20260807 06:44:46.972201 29804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:41205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:44:46.992808 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:35781/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35019
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:44:47.144503 30183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:44:47.144932 30183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:44:47.145016 30183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:44:47.147091 30183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:44:47.147357 30183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:44:47.147452 30183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:44:47.150033 30183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.137.148:35781/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35019
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:44:47.150532 30183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:44:47.150884 30183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:44:47.159515 30193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:44:47.159901 30183 server_base.cc:1034] running on GCE node
W20260807 06:44:47.159860 30191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:47.160684 30196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:44:47.160989 30183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:44:47.161355 30183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:44:47.168741 30183 hybrid_clock.cc:648] HybridClock initialized: now 1786085087168717 us; error 40 us; skew 500 ppm
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:44:47.172631 30183 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:44:47.173348 30183 webserver.cc:460] Webserver started at http://127.11.137.130:44641/ using document root <none> and password file <none>
I20260807 06:44:47.173839 30183 fs_manager.cc:359] Metadata directory not provided
I20260807 06:44:47.173970 30183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:44:47.174286 30183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:44:47.198108 30183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "b166838bf60f4b87b955dd813f528875"
format_stamp: "Formatted at 2026-08-07 06:44:47 on dist-test-slave-8hhm"
server_key: "f3820443e0a586668ac60de160b0b985"
server_key_iv: "f7096475e1c0b53f161895a3e52b9c94"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:47.198722 30183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "b166838bf60f4b87b955dd813f528875"
format_stamp: "Formatted at 2026-08-07 06:44:47 on dist-test-slave-8hhm"
server_key: "f3820443e0a586668ac60de160b0b985"
server_key_iv: "f7096475e1c0b53f161895a3e52b9c94"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:47.202859 30183 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260807 06:44:47.221401 30205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:47.221716 30183 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.001s
I20260807 06:44:47.221885 30183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "b166838bf60f4b87b955dd813f528875"
format_stamp: "Formatted at 2026-08-07 06:44:47 on dist-test-slave-8hhm"
server_key: "f3820443e0a586668ac60de160b0b985"
server_key_iv: "f7096475e1c0b53f161895a3e52b9c94"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:47.222069 30183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:44:47.247699 30183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:44:47.250450 30183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:44:47.250670 30183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:44:47.251073 30183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:44:47.251677 30183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:44:47.251789 30183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:47.251865 30183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:44:47.251924 30183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:47.263044 30183 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:43439
I20260807 06:44:47.263685 30183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:44:47.273348 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 30183
I20260807 06:44:47.273460 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:44:47.273682 11814 external_mini_cluster.cc:1428] Setting key d9a82e69ca8fac4ca0ec27cb4a9a93af
I20260807 06:44:47.277937 30389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:43439 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:44:47.297497 30395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.278721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35019 (local address 127.11.137.130:37511)
0807 06:44:47.285363 (+ 6642us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.285425 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.286304 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.286948 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.286954 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.287213 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:44:47.287496 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.287503 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.289279 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.289281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.290600 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.290603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.291206 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.291207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.291365 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.292043 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:44:47.292054 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:44:47.293827 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:44:47.295893 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:44:47.295899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:44:47.295902 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:44:47.296218 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:44:47.296422 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:44:47.296423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:44:47.296423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:44:47.296544 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:44:47.296825 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:44:47.296832 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:44:47.296988 (+ 156us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.297095 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.297267 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6543,"thread_start_us":210,"threads_started":1}
I20260807 06:44:47.298179 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.279141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:37511 (local address 127.11.137.190:35019)
0807 06:44:47.279200 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.279202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.285565 (+ 6363us) server_negotiation.cc:407] Connection header received
0807 06:44:47.286447 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.286449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.286467 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.286532 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:44:47.287617 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.288564 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.290729 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.291041 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.291107 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.293938 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:44:47.293939 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:44:47.293940 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:44:47.293947 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:44:47.295799 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:47.296301 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:47.296302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:47.296302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:47.296360 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:47.296613 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:47.296614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:47.296614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:47.296744 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:44:47.296798 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.297982 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.298080 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:44:47.298640 30390 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35019
I20260807 06:44:47.298743 30390 heartbeater.cc:464] Registering TS with master...
I20260807 06:44:47.298923 30390 heartbeater.cc:511] Master 127.11.137.190:35019 requested a full tablet report, sending...
I20260807 06:44:47.299274 29804 ts_manager.cc:194] Registered new tserver with Master: b166838bf60f4b87b955dd813f528875 (127.11.137.130:43439)
I20260807 06:44:47.299678 29804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:37511
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:44:47.310168 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:35781/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35019
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:44:47.478969 30400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:44:47.479261 30400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:44:47.479306 30400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:44:47.481238 30400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:44:47.481294 30400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:44:47.481333 30400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:44:47.483737 30400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.137.148:35781/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35019
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:44:47.483999 30400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:44:47.484362 30400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:44:47.491539 30413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:47.491954 30411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:44:47.492246 30410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:44:47.492524 30400 server_base.cc:1034] running on GCE node
I20260807 06:44:47.492712 30400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:44:47.492996 30400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:44:47.494160 30400 hybrid_clock.cc:648] HybridClock initialized: now 1786085087494135 us; error 38 us; skew 500 ppm
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:44:47.497771 30400 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:44:47.498423 30400 webserver.cc:460] Webserver started at http://127.11.137.131:40151/ using document root <none> and password file <none>
I20260807 06:44:47.498755 30400 fs_manager.cc:359] Metadata directory not provided
I20260807 06:44:47.498831 30400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:44:47.499055 30400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:44:47.514324 30400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "8e265bafe024451e9272293d22e7b267"
format_stamp: "Formatted at 2026-08-07 06:44:47 on dist-test-slave-8hhm"
server_key: "4bd0c6f6a6c914212c5a9a586357edc1"
server_key_iv: "cb7746783f855bab796cf9ed7fd0d5ca"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:47.514750 30400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "8e265bafe024451e9272293d22e7b267"
format_stamp: "Formatted at 2026-08-07 06:44:47 on dist-test-slave-8hhm"
server_key: "4bd0c6f6a6c914212c5a9a586357edc1"
server_key_iv: "cb7746783f855bab796cf9ed7fd0d5ca"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:47.516208 30400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:44:47.530813 30429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:47.531078 30400 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:44:47.531219 30400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "8e265bafe024451e9272293d22e7b267"
format_stamp: "Formatted at 2026-08-07 06:44:47 on dist-test-slave-8hhm"
server_key: "4bd0c6f6a6c914212c5a9a586357edc1"
server_key_iv: "cb7746783f855bab796cf9ed7fd0d5ca"
server_key_version: "kuduclusterkey@0"
I20260807 06:44:47.531378 30400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:44:47.560276 30400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:44:47.563141 30400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:44:47.563416 30400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:44:47.563789 30400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:44:47.564340 30400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:44:47.564472 30400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:47.564561 30400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:44:47.564628 30400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:44:47.575989 30400 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:35023
I20260807 06:44:47.576556 30400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:44:47.580415 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 30400
I20260807 06:44:47.580554 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:44:47.580790 11814 external_mini_cluster.cc:1428] Setting key 61faecdc8ce33e0b0670b072497dc7eb
I20260807 06:44:47.585978 30610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:35023 every 8 connection(s)
Aug 07 06:44:47 dist-test-slave-8hhm krb5kdc[29019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085087, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:44:47.610572 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.586740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:52431 (local address 127.11.137.190:35019)
0807 06:44:47.586815 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.586817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.593207 (+ 6390us) server_negotiation.cc:407] Connection header received
0807 06:44:47.598274 (+ 5067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.598276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.598301 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.598365 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:44:47.599532 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.600295 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.602233 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.602599 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.602706 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.606494 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:44:47.606496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:44:47.606496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:44:47.606506 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:44:47.608541 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:47.609170 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:47.609171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:47.609172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:47.609259 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:47.609656 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:47.609657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:47.609658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:47.609822 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:44:47.609897 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.610326 (+ 429us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.610428 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:44:47.610899 30614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.586756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35019 (local address 127.11.137.131:52431)
0807 06:44:47.593020 (+ 6264us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.593076 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.598119 (+ 5043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.598494 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.598501 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.598968 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:44:47.599408 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.599416 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.600405 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.600406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.602124 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.602127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.602718 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.602720 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.602961 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.603852 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:44:47.603865 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:44:47.606370 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:44:47.608645 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:44:47.608651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:44:47.608654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:44:47.609051 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:44:47.609331 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:44:47.609332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:44:47.609332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:44:47.609544 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:44:47.609909 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:44:47.609916 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:44:47.610152 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.610270 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.610530 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6199,"thread_start_us":165,"threads_started":1}
I20260807 06:44:47.611688 30612 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35019
I20260807 06:44:47.611824 30612 heartbeater.cc:464] Registering TS with master...
I20260807 06:44:47.612057 30612 heartbeater.cc:511] Master 127.11.137.190:35019 requested a full tablet report, sending...
I20260807 06:44:47.612542 29804 ts_manager.cc:194] Registered new tserver with Master: 8e265bafe024451e9272293d22e7b267 (127.11.137.131:35023)
I20260807 06:44:47.613075 29804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:52431
I20260807 06:44:47.615322 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:44:47.626792 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.617436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41306 (local address 127.11.137.190:35019)
0807 06:44:47.617481 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.617484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.617798 (+ 314us) server_negotiation.cc:407] Connection header received
0807 06:44:47.617851 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.617852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.617863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.617926 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:44:47.618813 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.619684 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.620992 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.621395 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.621476 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.623157 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:44:47.623158 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:44:47.623158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:44:47.623167 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:44:47.625249 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:47.625731 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:47.625733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:47.625734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:47.625819 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:44:47.626097 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:44:47.626098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:44:47.626099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:44:47.626267 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:44:47.626394 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.626537 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.626638 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:44:47.629503 29804 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:44:47.633076 29804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:44:47.644776 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.636894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:35023 (local address 127.0.0.1:43262)
0807 06:44:47.637766 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.637812 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.637891 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.638786 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.638790 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.638793 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:44:47.638879 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.638881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.641028 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.641029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.642804 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.642807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.644379 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.644381 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.644493 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.644508 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.644593 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.644657 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"thread_start_us":143,"threads_started":1}
I20260807 06:44:47.645514 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.636975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43262 (local address 127.11.137.131:35023)
0807 06:44:47.638468 (+ 1493us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.638480 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.638504 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:44:47.638602 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.638604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.638632 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.638789 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:44:47.638950 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.640910 (+ 1960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.642941 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.644037 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.644258 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.644332 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.645258 (+ 926us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.645316 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1438,"thread_start_us":158,"threads_started":1}
I20260807 06:44:47.646539 30502 tablet_service.cc:1467] Processing CreateTablet for tablet 5951551d9f9846c7a54ecf54aaa3fa22 (DEFAULT_TABLE table=test-table [id=8c628834d4e2402f8b48101d8212a1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:44:47.646982 30502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5951551d9f9846c7a54ecf54aaa3fa22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:44:47.653268 30635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.637504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36771 (local address 127.0.0.1:51926)
0807 06:44:47.641363 (+ 3859us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.641386 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.641464 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.641990 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.641991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.641993 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:44:47.642052 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.642054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.644851 (+ 2797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.644852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.651658 (+ 6806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.651661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.652849 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.652851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.652942 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.652949 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.653027 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.653086 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3833,"thread_start_us":123,"threads_started":1}
I20260807 06:44:47.653774 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.637368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.11.137.129:36771)
0807 06:44:47.638330 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.638346 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.641575 (+ 3229us) server_negotiation.cc:407] Connection header received
0807 06:44:47.641645 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.641648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.641674 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.641780 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:44:47.642176 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.644057 (+ 1881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.651837 (+ 7780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.652745 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.652824 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.652878 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.653600 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.653663 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":71,"threads_started":1}
I20260807 06:44:47.654521 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.637156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.11.137.130:43439)
0807 06:44:47.638156 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.638161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.641279 (+ 3118us) server_negotiation.cc:407] Connection header received
0807 06:44:47.644317 (+ 3038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.644320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.644379 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.644460 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:44:47.645571 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.647223 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.652960 (+ 5737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.653778 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.653832 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.653883 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.654398 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.654443 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":912,"thread_start_us":123,"threads_started":1}
I20260807 06:44:47.654912 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.636944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:43439 (local address 127.0.0.1:46144)
0807 06:44:47.641140 (+ 4196us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.641153 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.641902 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.644675 (+ 2773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.644676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.644678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:44:47.644744 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.644745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.647394 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.647394 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.651117 (+ 3723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.651121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.654229 (+ 3108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.654230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.654301 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.654305 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.654794 (+ 489us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.654841 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4144,"mutex_wait_us":1567,"thread_start_us":767,"threads_started":1}
I20260807 06:44:47.654930 30053 tablet_service.cc:1467] Processing CreateTablet for tablet 5951551d9f9846c7a54ecf54aaa3fa22 (DEFAULT_TABLE table=test-table [id=8c628834d4e2402f8b48101d8212a1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:44:47.655352 30053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5951551d9f9846c7a54ecf54aaa3fa22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:44:47.655685 30288 tablet_service.cc:1467] Processing CreateTablet for tablet 5951551d9f9846c7a54ecf54aaa3fa22 (DEFAULT_TABLE table=test-table [id=8c628834d4e2402f8b48101d8212a1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:44:47.656000 30288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5951551d9f9846c7a54ecf54aaa3fa22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:44:47.656970 30637 tablet_bootstrap.cc:492] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Bootstrap starting.
I20260807 06:44:47.658906 30637 tablet_bootstrap.cc:654] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Neither blocks nor log segments found. Creating new log.
I20260807 06:44:47.659843 30637 log.cc:824] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Log is configured to *not* fsync() on all Append() calls
I20260807 06:44:47.664914 30639 tablet_bootstrap.cc:492] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: Bootstrap starting.
I20260807 06:44:47.665921 30639 tablet_bootstrap.cc:654] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: Neither blocks nor log segments found. Creating new log.
I20260807 06:44:47.666462 30639 log.cc:824] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:44:47.666868 30640 tablet_bootstrap.cc:492] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: Bootstrap starting.
I20260807 06:44:47.667850 30640 tablet_bootstrap.cc:654] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: Neither blocks nor log segments found. Creating new log.
I20260807 06:44:47.668465 30640 log.cc:824] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: Log is configured to *not* fsync() on all Append() calls
I20260807 06:44:47.669615 30639 tablet_bootstrap.cc:492] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: No bootstrap required, opened a new log
I20260807 06:44:47.669693 30640 tablet_bootstrap.cc:492] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: No bootstrap required, opened a new log
I20260807 06:44:47.669766 30640 ts_tablet_manager.cc:1397] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:44:47.669759 30639 ts_tablet_manager.cc:1397] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260807 06:44:47.672451 30640 raft_consensus.cc:348] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.672623 30640 raft_consensus.cc:374] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:44:47.672659 30640 raft_consensus.cc:729] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b166838bf60f4b87b955dd813f528875, State: Initialized, Role: FOLLOWER
I20260807 06:44:47.672973 30640 consensus_queue.cc:260] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.673408 30640 ts_tablet_manager.cc:1428] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 06:44:47.673589 30390 heartbeater.cc:503] Master 127.11.137.190:35019 was elected leader, sending a full tablet report...
I20260807 06:44:47.673698 30639 raft_consensus.cc:348] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.673908 30639 raft_consensus.cc:374] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:44:47.673967 30639 raft_consensus.cc:729] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93477ff29cbd45ff8e7c449c710893a5, State: Initialized, Role: FOLLOWER
I20260807 06:44:47.674170 30639 consensus_queue.cc:260] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.674525 30639 ts_tablet_manager.cc:1428] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:44:47.674752 30166 heartbeater.cc:503] Master 127.11.137.190:35019 was elected leader, sending a full tablet report...
I20260807 06:44:47.676069 30637 tablet_bootstrap.cc:492] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: No bootstrap required, opened a new log
I20260807 06:44:47.676220 30637 ts_tablet_manager.cc:1397] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260807 06:44:47.679236 30637 raft_consensus.cc:348] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.679466 30637 raft_consensus.cc:374] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:44:47.679554 30637 raft_consensus.cc:729] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e265bafe024451e9272293d22e7b267, State: Initialized, Role: FOLLOWER
I20260807 06:44:47.679724 30637 consensus_queue.cc:260] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.680059 30637 ts_tablet_manager.cc:1428] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 06:44:47.680194 30612 heartbeater.cc:503] Master 127.11.137.190:35019 was elected leader, sending a full tablet report...
W20260807 06:44:47.700563 30167 tablet.cc:2369] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:44:47.710881 30648 raft_consensus.cc:482] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:44:47.711016 30648 raft_consensus.cc:504] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.711453 30648 leader_election.cc:288] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93477ff29cbd45ff8e7c449c710893a5 (127.11.137.129:36771), b166838bf60f4b87b955dd813f528875 (127.11.137.130:43439)
I20260807 06:44:47.716322 30614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.711756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36771 (local address 127.11.137.131:55435)
0807 06:44:47.711868 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.711880 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.711926 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.712234 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.712235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.712237 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:44:47.712314 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.712316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.713727 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.713728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.714894 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.714897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.716034 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.716036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.716125 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.716128 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.716198 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.716237 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 06:44:47.716874 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.712010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:55435 (local address 127.11.137.129:36771)
0807 06:44:47.712055 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.712057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.712065 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:44:47.712107 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.712108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.712120 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.712176 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:44:47.712400 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.713634 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.715184 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.715885 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.715970 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.715980 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.716760 (+ 780us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.716809 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:44:47.716995 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.712171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49991 (local address 127.11.137.130:43439)
0807 06:44:47.712215 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.712217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.713003 (+ 786us) server_negotiation.cc:407] Connection header received
0807 06:44:47.713111 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.713112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.713127 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.713157 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:44:47.713537 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.714253 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.715944 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.716565 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.716616 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.716624 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.716871 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.716911 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:44:47.717303 30649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.711867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:43439 (local address 127.11.137.131:49991)
0807 06:44:47.712915 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.712926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:44:47.713033 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:44:47.713273 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:44:47.713274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:44:47.713276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:44:47.713434 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.713437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.714550 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.714551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.715830 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:44:47.715833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.716720 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.716721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:44:47.716789 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.716793 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:44:47.717139 (+ 346us) client_negotiation.cc:240] Negotiation successful
0807 06:44:47.717182 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"thread_start_us":188,"threads_started":1}
I20260807 06:44:47.717177 30059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5951551d9f9846c7a54ecf54aaa3fa22" candidate_uuid: "8e265bafe024451e9272293d22e7b267" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93477ff29cbd45ff8e7c449c710893a5" is_pre_election: true
I20260807 06:44:47.717433 30059 raft_consensus.cc:2454] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e265bafe024451e9272293d22e7b267 in term 0.
I20260807 06:44:47.717675 30323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5951551d9f9846c7a54ecf54aaa3fa22" candidate_uuid: "8e265bafe024451e9272293d22e7b267" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b166838bf60f4b87b955dd813f528875" is_pre_election: true
I20260807 06:44:47.717847 30323 raft_consensus.cc:2454] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e265bafe024451e9272293d22e7b267 in term 0.
I20260807 06:44:47.718113 30431 leader_election.cc:302] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e265bafe024451e9272293d22e7b267, b166838bf60f4b87b955dd813f528875; no voters:
I20260807 06:44:47.718353 30648 raft_consensus.cc:2781] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:44:47.718437 30648 raft_consensus.cc:482] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:44:47.718465 30648 raft_consensus.cc:3037] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:44:47.719691 30648 raft_consensus.cc:504] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.719825 30648 leader_election.cc:288] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [CANDIDATE]: Term 1 election: Requested vote from peers 93477ff29cbd45ff8e7c449c710893a5 (127.11.137.129:36771), b166838bf60f4b87b955dd813f528875 (127.11.137.130:43439)
I20260807 06:44:47.720010 30323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5951551d9f9846c7a54ecf54aaa3fa22" candidate_uuid: "8e265bafe024451e9272293d22e7b267" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b166838bf60f4b87b955dd813f528875"
I20260807 06:44:47.720096 30323 raft_consensus.cc:3037] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:44:47.721108 30323 raft_consensus.cc:2454] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e265bafe024451e9272293d22e7b267 in term 1.
I20260807 06:44:47.721320 30431 leader_election.cc:302] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e265bafe024451e9272293d22e7b267, b166838bf60f4b87b955dd813f528875; no voters:
I20260807 06:44:47.721633 30059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5951551d9f9846c7a54ecf54aaa3fa22" candidate_uuid: "8e265bafe024451e9272293d22e7b267" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93477ff29cbd45ff8e7c449c710893a5"
I20260807 06:44:47.721717 30059 raft_consensus.cc:3037] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:44:47.722743 30059 raft_consensus.cc:2454] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e265bafe024451e9272293d22e7b267 in term 1.
I20260807 06:44:47.723013 30648 raft_consensus.cc:2781] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:44:47.723210 30648 raft_consensus.cc:686] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 1 LEADER]: Becoming Leader. State: Replica: 8e265bafe024451e9272293d22e7b267, State: Running, Role: LEADER
I20260807 06:44:47.723309 30648 consensus_queue.cc:237] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } }
I20260807 06:44:47.724236 29804 catalog_manager.cc:5495] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e265bafe024451e9272293d22e7b267 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "8e265bafe024451e9272293d22e7b267" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e265bafe024451e9272293d22e7b267" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 } health_report { overall_health: UNKNOWN } } }
I20260807 06:44:47.737802 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.734357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.11.137.131:35023)
0807 06:44:47.734406 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:44:47.734408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:44:47.734418 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:44:47.734452 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:44:47.734453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:44:47.734470 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:44:47.734555 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:44:47.734763 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.735467 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.736632 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:44:47.736941 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:44:47.737021 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:44:47.737255 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:44:47.737378 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:44:47.737460 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:44:47.737710 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 06:44:47.737733 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:44:47.739962 30059 raft_consensus.cc:1261] T 5951551d9f9846c7a54ecf54aaa3fa22 P 93477ff29cbd45ff8e7c449c710893a5 [term 1 FOLLOWER]: Refusing update from remote peer 8e265bafe024451e9272293d22e7b267: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:44:47.740087 30323 raft_consensus.cc:1261] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 1 FOLLOWER]: Refusing update from remote peer 8e265bafe024451e9272293d22e7b267: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:44:47.740437 30651 consensus_queue.cc:1035] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93477ff29cbd45ff8e7c449c710893a5" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:44:47.740620 30651 consensus_queue.cc:1035] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b166838bf60f4b87b955dd813f528875" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:44:47.744508 30657 mvcc.cc:205] Tried to move back new op lower bound from 7315804519379599360 to 7315804519315316736. Current Snapshot: MvccSnapshot[applied={T|T < 7315804519379599360}]
I20260807 06:44:47.748457 30660 mvcc.cc:205] Tried to move back new op lower bound from 7315804519379599360 to 7315804519315316736. Current Snapshot: MvccSnapshot[applied={T|T < 7315804519379599360}]
I20260807 06:44:47.748663 29803 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:44:47.748759 29803 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:44:47.749871 29803 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c832996494f472a99c200c01dc2d5b6: Sending DeleteTablet for 3 replicas of tablet 5951551d9f9846c7a54ecf54aaa3fa22
I20260807 06:44:47.750381 30053 tablet_service.cc:1514] Processing DeleteTablet for tablet 5951551d9f9846c7a54ecf54aaa3fa22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:44:47 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:51926
I20260807 06:44:47.750736 30502 tablet_service.cc:1514] Processing DeleteTablet for tablet 5951551d9f9846c7a54ecf54aaa3fa22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:44:47 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:43262
I20260807 06:44:47.751068 30288 tablet_service.cc:1514] Processing DeleteTablet for tablet 5951551d9f9846c7a54ecf54aaa3fa22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:44:47 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:46144
I20260807 06:44:47.751889 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 29950
I20260807 06:44:47.769649 30670 tablet_replica.cc:330] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: stopping tablet replica
I20260807 06:44:47.769899 30672 tablet_replica.cc:330] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875: stopping tablet replica
I20260807 06:44:47.775187 30672 raft_consensus.cc:2229] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:44:47.775421 30670 raft_consensus.cc:2229] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:44:47.775621 30670 raft_consensus.cc:2258] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:44:47.775813 30672 raft_consensus.cc:2258] T 5951551d9f9846c7a54ecf54aaa3fa22 P b166838bf60f4b87b955dd813f528875 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:44:47.776508 30670 ts_tablet_manager.cc:1905] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:44:47.778863 30670 ts_tablet_manager.cc:1918] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:44:47.779016 30670 log.cc:1196] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/5951551d9f9846c7a54ecf54aaa3fa22
I20260807 06:44:47.779417 30670 ts_tablet_manager.cc:1939] T 5951551d9f9846c7a54ecf54aaa3fa22 P 8e265bafe024451e9272293d22e7b267: Deleting consensus metadata
I20260807 06:44:47.779963 29782 catalog_manager.cc:4841] TS 8e265bafe024451e9272293d22e7b267 (127.11.137.131:35023): tablet 5951551d9f9846c7a54ecf54aaa3fa22 (table test-table [id=8c628834d4e2402f8b48101d8212a1c4]) successfully deleted
W20260807 06:44:47.780468 29782 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:36771 (error 108)
I20260807 06:44:47.781409 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.781296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:36771 (local address 127.0.0.1:51934)
0807 06:44:47.781342 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.781379 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:36771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 06:44:47.781632 29782 catalog_manager.cc:4584] TS 93477ff29cbd45ff8e7c449c710893a5 (127.11.137.129:36771): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5951551d9f9846c7a54ecf54aaa3fa22: Network error: Client connection negotiation failed: client connection to 127.11.137.129:36771: connect: Connection refused (error 111)
I20260807 06:44:47.781872 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 30183
I20260807 06:44:47.795210 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 30400
I20260807 06:44:47.805661 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:44:47.805498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:43439 (local address 127.0.0.1:46152)
0807 06:44:47.805573 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0807 06:44:47.805617 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.130:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 06:44:47.807080 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 29755
I20260807 06:44:47.822669 11814 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 06:44:48.167493 11814 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 06:44:48.167606 11814 mini_ranger.cc:66] Stopping Ranger...
I20260807 06:44:48.512248 11814 mini_ranger.cc:68] Stopped Ranger
2026-08-07 06:44:48.512 UTC [29077] LOG: received smart shutdown request
2026-08-07 06:44:48.516 UTC [29077] LOG: background worker "logical replication launcher" (PID 29091) exited with exit code 1
2026-08-07 06:44:48.516 UTC [29084] LOG: shutting down
2026-08-07 06:44:48.686 UTC [29077] LOG: database system is shut down
2026-08-07T06:44:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49167 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:44:48 dist-test-slave-8hhm krb5kdc[30685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:44:48 dist-test-slave-8hhm krb5kdc[30685](info): set up 2 sockets
Aug 07 06:44:48 dist-test-slave-8hhm krb5kdc[30685](info): commencing operation
krb5kdc: starting...
W20260807 06:44:50.052721 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:44:50 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:44:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:44:50Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/rangeradmin_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/rangeradmin_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/rangerlookup_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/rangerlookup_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
I20260807 06:44:50.219159 11814 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBunj0a/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/postgres -l logfile start
2026-08-07 06:44:52.654 UTC [30731] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 06:44:52.654 UTC [30731] LOG: listening on IPv4 address "127.11.137.148", port 37345
2026-08-07 06:44:52.658 UTC [30731] LOG: listening on Unix socket "/tmp/.s.PGSQL.37345"
2026-08-07 06:44:52.680 UTC [30735] LOG: database system was shut down at 2026-08-07 06:44:51 UTC
2026-08-07 06:44:52.683 UTC [30731] LOG: database system is ready to accept connections
I20260807 06:44:53.830416 11814 mini_postgres.cc:96] Postgres bound to 37345
2026-08-07 06:44:53.837 UTC [30752] FATAL: database "slave" does not exist
127.11.137.148:37345 - accepting connections
I20260807 06:44:53.838274 11814 mini_ranger.cc:161] Starting Ranger...
I20260807 06:44:53.854135 11814 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 06:44:54.323122 11814 mini_ranger.cc:87] Created ranger Postgres database
I20260807 06:44:54.323221 11814 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-admin
2026-08-07 06:44:54,605 [I] DB FLAVOR :POSTGRES
2026-08-07 06:44:54,606 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:44:54,606 [I] Checking connection..
2026-08-07 06:44:54,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 06:44:54,852 [I] Checking connection passed.
2026-08-07 06:44:54,853 [I] --------- Verifying version history table ---------
2026-08-07 06:44:54,853 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:44:55,114 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:44:55,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:44:55,377 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:44:55,377 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 06:44:55,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 06:44:55.641 UTC [30846] WARNING: there is no transaction in progress
2026-08-07 06:44:55,650 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 06:44:55,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:44:55,895 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 06:44:55,896 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:44:55,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 06:44:56,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 06:44:56,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8hhm.c.gcp-upstream.internal','N') ;"
2026-08-07 06:44:56,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:44:56,931 [I] Table x_portal_user does not exist in database ranger
2026-08-07 06:44:56,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:44:57,185 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 06:44:57,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:44:57,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:44:57,700 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 06:44:57,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 06:44:58.637 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.653 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.669 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.683 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.700 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.718 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.771 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.778 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.793 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.804 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.814 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.828 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.838 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.845 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.851 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:58.858 UTC [31034] WARNING: there is no transaction in progress
2026-08-07 06:44:59,483 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 06:44:59,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 06:44:59,735 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 06:44:59,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:44:59,995 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 06:44:59,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:45:00,248 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 06:45:00,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:45:00,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:45:00,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8hhm.c.gcp-upstream.internal';"
2026-08-07 06:45:00,993 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 06:45:00,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 06:45:01,261 [I] DB_PATCHES have already been applied
I20260807 06:45:01.267302 11814 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBunj0a/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 06:45:01.267362 11814 mini_ranger.cc:193] Using host: 127.11.137.148
I20260807 06:45:01.271284 11814 mini_ranger.cc:227] Ranger admin URL: http://127.11.137.148:43827
Aug 07, 2026 6:45:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:45:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:45:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:45:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:45:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:45:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:45:02 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 06:45:02.667506 11814 mini_ranger.cc:160] Time spent starting Ranger: real 8.829s user 0.000s sys 0.011s
Aug 07, 2026 6:45:21 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:45:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 6:45:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:45:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:45:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 06:45:23.605055 11814 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.137.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.137.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/rangerkms_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.137.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/rangerkms_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.137.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.137.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.137.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/HTTP_127.11.137.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 06:45:23 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085123, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 06:45:23.691524 11814 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 06:45:23.700920 11814 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 06:45:24.535424 11814 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 06:45:24.535518 11814 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms
I20260807 06:45:24.535537 11814 mini_ranger_kms.cc:227] Using postgres at 127.11.137.148:37345
2026-08-07 06:45:24,723 [I] DB FLAVOR :POSTGRES
2026-08-07 06:45:24,723 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:45:24,723 [I] Checking connection
2026-08-07 06:45:24,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 06:45:24,972 [I] connection success
2026-08-07 06:45:24,973 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 06:45:24,973 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 06:45:24,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 06:45:25,210 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 06:45:25,211 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:45:25,211 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 06:45:25,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.137.148:37345/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 06:45:25,476 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 06:45:25.950860 11814 mini_ranger_kms.cc:310] Created kms service
I20260807 06:45:26.118314 11814 mini_ranger_kms.cc:326] Created kudu user
I20260807 06:45:26.162313 11814 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 06:45:26 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085123, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:26.568636 11814 mini_ranger_kms.cc:384] Added ranger policy
I20260807 06:45:26.568861 11814 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBunj0a/build/release/bin/postgresql.jar:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBunj0a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 06:45:26.568883 11814 mini_ranger_kms.cc:240] Using host: 127.11.137.148
I20260807 06:45:26.573067 11814 mini_ranger_kms.cc:276] Ranger KMS PID: 31297
I20260807 06:45:26.573149 11814 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.137.148:44845
Aug 07, 2026 6:45:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:45:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:45:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:45:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:45:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:45:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 06:45:28 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085128, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.137.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:29.342924 11814 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.651s user 0.001s sys 0.170s
I20260807 06:45:29.343040 11814 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 06:45:29.343104 11814 mini_ranger_kms.cc:401] 127.11.137.148:44845/kms/v1/keys
Aug 07 06:45:29 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085128, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.137.148@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
Aug 07 06:45:29 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085128, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.137.148@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
Aug 07 06:45:32 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:45:32.103606 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39035
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:39035
--ranger_config_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:32.187103 31379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:32.187300 31379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:32.187321 31379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:32.188585 31379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:32.188637 31379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:32.188651 31379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:32.188683 31379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:32.188706 31379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:32.190294 31379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.137.148:44845/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:39035
--ranger_config_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:32.190523 31379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:32.190771 31379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:32.196959 31396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:32.196990 31390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:32.197180 31389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:32.197075 31379 server_base.cc:1034] running on GCE node
I20260807 06:45:32.197500 31379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:32.197845 31379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:32.199007 31379 hybrid_clock.cc:648] HybridClock initialized: now 1786085132198982 us; error 43 us; skew 500 ppm
Aug 07 06:45:32 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085132, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:32.206130 31379 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:32.206686 31379 webserver.cc:460] Webserver started at http://127.11.137.190:38285/ using document root <none> and password file <none>
I20260807 06:45:32.206955 31379 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:32.207012 31379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:32.207140 31379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:45:32 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085132, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:32.253278 31379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "fa0f93845e214e9baef33187fb64fd7f"
format_stamp: "Formatted at 2026-08-07 06:45:32 on dist-test-slave-8hhm"
server_key: "07df494c4e073eb3aefd639fc8051b60"
server_key_iv: "a6cad344b97685dc07f2b87b33d0770a"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:32.253746 31379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "fa0f93845e214e9baef33187fb64fd7f"
format_stamp: "Formatted at 2026-08-07 06:45:32 on dist-test-slave-8hhm"
server_key: "07df494c4e073eb3aefd639fc8051b60"
server_key_iv: "a6cad344b97685dc07f2b87b33d0770a"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:32.255261 31379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:45:32.270104 31406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:32.270320 31379 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:32.270429 31379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "fa0f93845e214e9baef33187fb64fd7f"
format_stamp: "Formatted at 2026-08-07 06:45:32 on dist-test-slave-8hhm"
server_key: "07df494c4e073eb3aefd639fc8051b60"
server_key_iv: "a6cad344b97685dc07f2b87b33d0770a"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:32.270525 31379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:32.289383 31379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:32.291245 31379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:32.291405 31379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:32.296442 31379 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:39035
I20260807 06:45:32.296514 31483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:39035 every 8 connection(s)
I20260807 06:45:32.296877 31379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:32.297665 31485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:32.300001 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 31379
I20260807 06:45:32.300105 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:45:32.300050 31485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Bootstrap starting.
I20260807 06:45:32.300282 11814 external_mini_cluster.cc:1428] Setting key 2df56366642d149984d749b5e22f314a
I20260807 06:45:32.300823 31485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:32.301291 31485 log.cc:824] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:32.302107 31485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: No bootstrap required, opened a new log
I20260807 06:45:32.303658 31485 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:32.303825 31485 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:32.303889 31485 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa0f93845e214e9baef33187fb64fd7f, State: Initialized, Role: FOLLOWER
I20260807 06:45:32.304028 31485 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:32.304179 31485 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:45:32.304235 31485 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:45:32.304311 31485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:32.304939 31485 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:32.305053 31485 leader_election.cc:302] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa0f93845e214e9baef33187fb64fd7f; no voters:
I20260807 06:45:32.305296 31485 leader_election.cc:288] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:45:32.305341 31494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:32.305598 31494 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 LEADER]: Becoming Leader. State: Replica: fa0f93845e214e9baef33187fb64fd7f, State: Running, Role: LEADER
I20260807 06:45:32.305758 31494 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:32.305639 31485 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:32.306166 31497 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa0f93845e214e9baef33187fb64fd7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } } }
I20260807 06:45:32.306243 31497 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:32.307175 31496 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa0f93845e214e9baef33187fb64fd7f. Latest consensus state: current_term: 1 leader_uuid: "fa0f93845e214e9baef33187fb64fd7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } } }
I20260807 06:45:32.307268 31496 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:32.307861 31499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:32.308388 31499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:32.308678 31485 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 07 06:45:32 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:32.310343 31499 catalog_manager.cc:1347] Generated new cluster ID: 13b1db7b44ee4d43b8a81179af4c139c
I20260807 06:45:32.310389 31499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:45:32.313771 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:32.300814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.11.137.190:39035)
0807 06:45:32.301018 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:32.301028 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:32.301058 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:45:32.301654 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:32.301665 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:32.301745 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:32.301901 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:32.302752 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:32.304609 (+ 1857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:32.305799 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:32.306672 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:32.306779 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:32.309658 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:32.309662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:32.309663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:32.309686 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:32.311671 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:32.312123 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:32.312126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:32.312126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:32.312227 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:32.312426 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:32.312427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:32.312427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:32.312729 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:32.312889 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:32.313422 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 06:45:32.313543 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
I20260807 06:45:32.344534 31499 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:45:32.345463 31499 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:45:32.350929 31499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Generated new TSK 0
I20260807 06:45:32.351188 31499 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:45:33.119714 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39035
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:33.208101 31553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:33.208321 31553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:33.208360 31553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:33.209551 31553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:33.209609 31553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:33.209652 31553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:45:33.211205 31553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.137.148:44845/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:33.211459 31553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:33.211723 31553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:33.216863 31559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:33.216945 31558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:33.217043 31562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:33.217370 31553 server_base.cc:1034] running on GCE node
I20260807 06:45:33.217643 31553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:33.217924 31553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:33.219084 31553 hybrid_clock.cc:648] HybridClock initialized: now 1786085133219064 us; error 35 us; skew 500 ppm
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:33.221698 31553 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:45:33.222150 31553 webserver.cc:460] Webserver started at http://127.11.137.129:45025/ using document root <none> and password file <none>
I20260807 06:45:33.222386 31553 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:33.222476 31553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:33.222613 31553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:33.235627 31553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "5b05cbb05d2646b68f948f2771074d9f"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "123e39125b3121a6ffdbde1ba91e7896"
server_key_iv: "57d9c4e448fff3bf5e677ac881fae7fc"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.236178 31553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "5b05cbb05d2646b68f948f2771074d9f"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "123e39125b3121a6ffdbde1ba91e7896"
server_key_iv: "57d9c4e448fff3bf5e677ac881fae7fc"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.238077 31553 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:45:33.250805 31571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.251044 31553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:33.251169 31553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "5b05cbb05d2646b68f948f2771074d9f"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "123e39125b3121a6ffdbde1ba91e7896"
server_key_iv: "57d9c4e448fff3bf5e677ac881fae7fc"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.251272 31553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:33.271385 31553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:33.273881 31553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:33.274173 31553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:33.274490 31553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:33.274899 31553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:33.274991 31553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.275136 31553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:33.275213 31553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.282196 31553 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:39603
I20260807 06:45:33.282346 31767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:39603 every 8 connection(s)
I20260807 06:45:33.282755 31553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:45:33.286101 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 31553
I20260807 06:45:33.286211 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:45:33.286423 11814 external_mini_cluster.cc:1428] Setting key 38141338711b0b8cd5f1f431833452bc
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:33.296680 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:33.283850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:58649 (local address 127.11.137.190:39035)
0807 06:45:33.283986 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:33.283988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:33.285508 (+ 1520us) server_negotiation.cc:407] Connection header received
0807 06:45:33.286386 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:33.286388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:33.286405 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:33.286519 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:33.287476 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.288253 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.289724 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.290008 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.290058 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:33.292772 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:33.292774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:33.292774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:33.292782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:33.294880 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:33.295432 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:33.295434 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:33.295434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:33.295509 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:33.295819 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:33.295820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:33.295821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:33.295983 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:33.296035 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:33.296447 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 06:45:33.296550 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260807 06:45:33.297559 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:33.283840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39035 (local address 127.11.137.129:58649)
0807 06:45:33.285369 (+ 1529us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:33.285416 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:33.286142 (+ 726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:33.286824 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:33.286829 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:33.287085 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:33.287358 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:33.287366 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.288376 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.288377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:33.289619 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:33.289623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.290189 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.290190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:33.290325 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:33.290889 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:33.290899 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:33.292654 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:33.294988 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:33.294995 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:33.294997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:33.295328 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:33.295589 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:33.295590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:33.295590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:33.295730 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:33.296100 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:33.296107 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:33.296281 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 06:45:33.297036 (+ 755us) client_negotiation.cc:240] Negotiation successful
0807 06:45:33.297286 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1483,"thread_start_us":74,"threads_started":1}
I20260807 06:45:33.298404 31770 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39035
I20260807 06:45:33.298501 31770 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:33.298692 31770 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:33.299358 31432 ts_manager.cc:194] Registered new tserver with Master: 5b05cbb05d2646b68f948f2771074d9f (127.11.137.129:39603)
I20260807 06:45:33.300230 31432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:58649
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:45:33.329838 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39035
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:33.454536 31780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:33.454860 31780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:33.454905 31780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:33.456615 31780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:33.456776 31780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:33.456832 31780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:45:33.458962 31780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.137.148:44845/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:33.459220 31780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:33.459479 31780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:33.466029 31792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:33.466224 31791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:33.466012 31795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:33.466761 31780 server_base.cc:1034] running on GCE node
I20260807 06:45:33.467079 31780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:33.467352 31780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:33.474727 31780 hybrid_clock.cc:648] HybridClock initialized: now 1786085133474684 us; error 50 us; skew 500 ppm
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:33.478369 31780 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:45:33.479224 31780 webserver.cc:460] Webserver started at http://127.11.137.130:34685/ using document root <none> and password file <none>
I20260807 06:45:33.479538 31780 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:33.479660 31780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:33.479862 31780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:33.497169 31780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "2a62085dd4824ec987d901d340a199dd"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "d6afeb9fd01e1e2182f9431cf2a58aa1"
server_key_iv: "9c9e55517973bde47a79167c7746395c"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.497706 31780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "2a62085dd4824ec987d901d340a199dd"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "d6afeb9fd01e1e2182f9431cf2a58aa1"
server_key_iv: "9c9e55517973bde47a79167c7746395c"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.503464 31780 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260807 06:45:33.527701 31809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.527886 31780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:45:33.527983 31780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "2a62085dd4824ec987d901d340a199dd"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "d6afeb9fd01e1e2182f9431cf2a58aa1"
server_key_iv: "9c9e55517973bde47a79167c7746395c"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.528095 31780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:33.548810 31780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:33.551287 31780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:33.551446 31780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:33.551662 31780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:33.552027 31780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:33.552078 31780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.552107 31780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:33.552125 31780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.559497 31780 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:46653
I20260807 06:45:33.559638 32003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:46653 every 8 connection(s)
I20260807 06:45:33.559926 31780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:33.568131 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 31780
I20260807 06:45:33.568231 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:45:33.568434 11814 external_mini_cluster.cc:1428] Setting key fc85c1b5fa34340ba8d36936d88fa08b
I20260807 06:45:33.571457 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:33.560729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:52461 (local address 127.11.137.190:39035)
0807 06:45:33.560791 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:33.560793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:33.561461 (+ 668us) server_negotiation.cc:407] Connection header received
0807 06:45:33.562152 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:33.562154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:33.562171 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:33.562204 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:33.563006 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.563794 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.565242 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.565572 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.565616 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:33.568148 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:33.568149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:33.568149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:33.568156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:33.569976 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:33.570445 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:33.570446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:33.570447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:33.570504 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:33.570759 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:33.570760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:33.570760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:33.570882 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:33.570922 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:33.571278 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 06:45:33.571364 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 06:45:33.572160 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:33.560693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39035 (local address 127.11.137.130:52461)
0807 06:45:33.561338 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:33.561378 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:33.562007 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:33.562389 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:33.562393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:33.562631 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:33.562892 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:33.562899 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.563908 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.563909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:33.565119 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:33.565122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.565730 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.565730 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:33.565862 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:33.566420 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:33.566443 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:33.568026 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:33.570080 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:33.570086 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:33.570088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:33.570358 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:33.570572 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:33.570572 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:33.570573 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:33.570690 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:33.570966 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:33.570971 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:33.571128 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 06:45:33.571777 (+ 649us) client_negotiation.cc:240] Negotiation successful
0807 06:45:33.571930 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":94,"threads_started":1}
I20260807 06:45:33.572803 32004 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39035
I20260807 06:45:33.572937 32004 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:33.573251 32004 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:33.573657 31432 ts_manager.cc:194] Registered new tserver with Master: 2a62085dd4824ec987d901d340a199dd (127.11.137.130:46653)
I20260807 06:45:33.574115 31432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:52461
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:45:33.604326 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39035
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:33.741727 32010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:33.742050 32010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:33.742091 32010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:33.743875 32010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:33.743939 32010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:33.743979 32010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:45:33.746500 32010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.137.148:44845/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:33.746778 32010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:33.747071 32010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:33.754388 32020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:33.754392 32023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:33.754739 32017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:33.755319 32010 server_base.cc:1034] running on GCE node
I20260807 06:45:33.755535 32010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:33.755797 32010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:33.756975 32010 hybrid_clock.cc:648] HybridClock initialized: now 1786085133756956 us; error 42 us; skew 500 ppm
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:33.760504 32010 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:45:33.761025 32010 webserver.cc:460] Webserver started at http://127.11.137.131:38385/ using document root <none> and password file <none>
I20260807 06:45:33.761402 32010 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:33.761533 32010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:33.761730 32010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:33.781160 32010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "9b072b2944364b5397c91603cb989519"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "0abfcb2e7be88b700ff5fff4e221c6be"
server_key_iv: "e9946426da18f20723274318dadbf9a8"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.781666 32010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "9b072b2944364b5397c91603cb989519"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "0abfcb2e7be88b700ff5fff4e221c6be"
server_key_iv: "e9946426da18f20723274318dadbf9a8"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.788533 32010 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.002s
I20260807 06:45:33.813917 32037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.814219 32010 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260807 06:45:33.814325 32010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "9b072b2944364b5397c91603cb989519"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "0abfcb2e7be88b700ff5fff4e221c6be"
server_key_iv: "e9946426da18f20723274318dadbf9a8"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:33.814426 32010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:33.830590 32010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:33.833485 32010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:33.833693 32010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:33.833940 32010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:33.834400 32010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:33.834455 32010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.834491 32010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:33.834519 32010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:33.849077 32010 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:36953
I20260807 06:45:33.849468 32223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:36953 every 8 connection(s)
I20260807 06:45:33.849718 32010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:45:33.854784 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 32010
I20260807 06:45:33.854975 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:45:33.855306 11814 external_mini_cluster.cc:1428] Setting key 2095e10451c2a15a25dfd5dec80bec94
Aug 07 06:45:33 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085133, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:33.865252 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:33.850715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:60465 (local address 127.11.137.190:39035)
0807 06:45:33.850796 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:33.850798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:33.851371 (+ 573us) server_negotiation.cc:407] Connection header received
0807 06:45:33.852608 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:33.852609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:33.852623 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:33.852698 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:33.854255 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.855020 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.856763 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.857099 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.857141 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:33.860963 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:33.860965 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:33.860965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:33.860973 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:33.862861 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:33.863781 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:33.863783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:33.863783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:33.863844 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:33.864317 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:33.864318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:33.864318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:33.864466 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:33.864538 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:33.865035 (+ 497us) server_negotiation.cc:299] Negotiation successful
0807 06:45:33.865131 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:45:33.865900 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:33.850700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39035 (local address 127.11.137.131:60465)
0807 06:45:33.851099 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:33.851189 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:33.852454 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:33.852833 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:33.852845 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:33.853487 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:33.854106 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:33.854114 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.855139 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.855140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:33.856663 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:33.856666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:33.857282 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:33.857283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:33.857494 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:33.858374 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:33.858385 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:33.860845 (+ 2460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:33.862957 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:33.862975 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:33.862977 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:33.863527 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:33.863939 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:33.863940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:33.863940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:33.864214 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:33.864554 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:33.864561 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:33.864836 (+ 275us) client_negotiation.cc:769] Sending connection context
0807 06:45:33.865009 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 06:45:33.865259 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":180,"threads_started":1}
I20260807 06:45:33.866847 32224 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39035
I20260807 06:45:33.867056 32224 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:33.867458 32224 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:33.868256 31432 ts_manager.cc:194] Registered new tserver with Master: 9b072b2944364b5397c91603cb989519 (127.11.137.131:36953)
I20260807 06:45:33.868978 31432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:60465
I20260807 06:45:33.869540 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:45:33.870198 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 31553
I20260807 06:45:33.886730 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 31780
I20260807 06:45:33.897375 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 32010
I20260807 06:45:33.912092 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 31379
I20260807 06:45:33.926270 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39035
--webserver_interface=127.11.137.190
--webserver_port=38285
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:39035
--ranger_config_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:34.009596 32228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:34.009841 32228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:34.009891 32228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:34.010993 32228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:34.011057 32228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:34.011081 32228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:34.011108 32228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:34.011152 32228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:34.012785 32228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:39035
--ranger_config_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=38285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:34.013072 32228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:34.013321 32228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:34.018325 32238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.018342 32242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.018383 32239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:34.018600 32228 server_base.cc:1034] running on GCE node
I20260807 06:45:34.018958 32228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:34.019294 32228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:34.020465 32228 hybrid_clock.cc:648] HybridClock initialized: now 1786085134020452 us; error 28 us; skew 500 ppm
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:34.023219 32228 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:34.023756 32228 webserver.cc:460] Webserver started at http://127.11.137.190:38285/ using document root <none> and password file <none>
I20260807 06:45:34.024034 32228 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:34.024112 32228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:34.049814 32228 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:34.050596 32254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.050812 32228 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:34.050932 32228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "fa0f93845e214e9baef33187fb64fd7f"
format_stamp: "Formatted at 2026-08-07 06:45:32 on dist-test-slave-8hhm"
server_key: "07df494c4e073eb3aefd639fc8051b60"
server_key_iv: "a6cad344b97685dc07f2b87b33d0770a"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:34.051308 32228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:34.059993 32228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:34.062211 32228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:34.062357 32228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:34.067374 32228 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:39035
I20260807 06:45:34.067528 32333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:39035 every 8 connection(s)
I20260807 06:45:34.067854 32228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:34.069195 32335 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:45:34.069962 32335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Bootstrap starting.
I20260807 06:45:34.072145 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 32228
I20260807 06:45:34.072468 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:39603
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:39035
--webserver_port=45025
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:34.079882 32335 log.cc:824] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:34.082686 32335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:45:34.083035 32335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Bootstrap complete.
I20260807 06:45:34.087093 32335 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:34.087440 32335 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa0f93845e214e9baef33187fb64fd7f, State: Initialized, Role: FOLLOWER
I20260807 06:45:34.087649 32335 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:34.087724 32335 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:45:34.087778 32335 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:45:34.087829 32335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:45:34.089186 32335 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:34.089320 32335 leader_election.cc:302] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa0f93845e214e9baef33187fb64fd7f; no voters:
I20260807 06:45:34.089493 32335 leader_election.cc:288] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:45:34.089571 32340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:45:34.089748 32340 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [term 2 LEADER]: Becoming Leader. State: Replica: fa0f93845e214e9baef33187fb64fd7f, State: Running, Role: LEADER
I20260807 06:45:34.089787 32335 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:34.089875 32340 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } }
I20260807 06:45:34.090201 32340 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fa0f93845e214e9baef33187fb64fd7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } } }
I20260807 06:45:34.090292 32340 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:34.090444 32340 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa0f93845e214e9baef33187fb64fd7f. Latest consensus state: current_term: 2 leader_uuid: "fa0f93845e214e9baef33187fb64fd7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa0f93845e214e9baef33187fb64fd7f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39035 } } }
I20260807 06:45:34.090512 32340 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:34.091367 32335 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:45:34.095324 32353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:34.096025 32353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:34.096242 32353 catalog_manager.cc:1259] Loaded cluster ID: 13b1db7b44ee4d43b8a81179af4c139c
I20260807 06:45:34.096289 32353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:45:34.098328 32353 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:45:34.098565 32353 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Loaded TSK: 0
I20260807 06:45:34.098836 32353 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:45:34.202188 32337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:34.202457 32337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:34.202497 32337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:34.204157 32337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:34.204211 32337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:34.204253 32337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:45:34.206370 32337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:39603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=45025
--tserver_master_addrs=127.11.137.190:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:34.206650 32337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:34.206877 32337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:34.213295 32388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:34.213369 32337 server_base.cc:1034] running on GCE node
W20260807 06:45:34.213181 32392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.213656 32390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:34.213879 32337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:34.214180 32337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:34.215376 32337 hybrid_clock.cc:648] HybridClock initialized: now 1786085134215319 us; error 53 us; skew 500 ppm
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:34.218762 32337 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:45:34.219295 32337 webserver.cc:460] Webserver started at http://127.11.137.129:45025/ using document root <none> and password file <none>
I20260807 06:45:34.219584 32337 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:34.219691 32337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:34.245559 32337 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:45:34.249485 32409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.249694 32337 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260807 06:45:34.249796 32337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "5b05cbb05d2646b68f948f2771074d9f"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "123e39125b3121a6ffdbde1ba91e7896"
server_key_iv: "57d9c4e448fff3bf5e677ac881fae7fc"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:34.250269 32337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:34.288039 32337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:34.290323 32337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:34.290499 32337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:34.290850 32337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:34.291260 32337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:34.291317 32337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.291349 32337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:34.291370 32337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.299031 32337 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:39603
I20260807 06:45:34.299141 32582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:39603 every 8 connection(s)
I20260807 06:45:34.299484 32337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:45:34.301460 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 32337
I20260807 06:45:34.301774 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:46653
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:39035
--webserver_port=34685
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:34.312186 32586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.300425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:33183 (local address 127.11.137.190:39035)
0807 06:45:34.300639 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:34.300647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:34.300674 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:45:34.301554 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:34.301561 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:34.301620 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:34.301756 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:34.302599 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.303935 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.305248 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.305661 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.305798 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.307983 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:34.307987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:34.307987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:34.307999 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:34.310136 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.310687 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.310691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.310691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.310801 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.311099 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.311100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.311100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.311395 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:34.311459 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:34.311869 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 06:45:34.311978 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":76,"threads_started":1}
I20260807 06:45:34.312202 32585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.300259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39035 (local address 127.11.137.129:33183)
0807 06:45:34.300462 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:34.300515 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:34.301183 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:34.301914 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:34.301918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:34.302167 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:34.302439 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:34.302446 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.304065 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.304066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:34.305127 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:34.305130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.305792 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.305793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:34.305914 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.306470 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:34.306478 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:34.307873 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:34.310248 (+ 2375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:34.310255 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:34.310257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:34.310564 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:34.310886 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:34.310887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:34.310887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:34.311018 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:34.311515 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:34.311521 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:34.311681 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 06:45:34.311810 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 06:45:34.311972 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":109,"threads_started":1}
I20260807 06:45:34.313683 32583 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39035
I20260807 06:45:34.313808 32583 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.313992 32583 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
W20260807 06:45:34.314873 32583 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:39035 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:45:34.314944 32583 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.315007 32583 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:34.315424 32583 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.315500 32583 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
W20260807 06:45:34.315848 32583 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:45:34.426628 32589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:34.426920 32589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:34.426957 32589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:34.428656 32589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:34.428711 32589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:34.428752 32589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:45:34.430903 32589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:46653
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=34685
--tserver_master_addrs=127.11.137.190:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:34.431180 32589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:34.431512 32589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:34.437554 32600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.437526 32596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.438102 32597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:34.441498 32589 server_base.cc:1034] running on GCE node
I20260807 06:45:34.441736 32589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:34.442008 32589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:34.443182 32589 hybrid_clock.cc:648] HybridClock initialized: now 1786085134443165 us; error 31 us; skew 500 ppm
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:34.446378 32589 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:45:34.446934 32589 webserver.cc:460] Webserver started at http://127.11.137.130:34685/ using document root <none> and password file <none>
I20260807 06:45:34.447220 32589 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:34.447294 32589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:34.466231 32589 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:34.467470 32611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.467708 32589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:34.467864 32589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "2a62085dd4824ec987d901d340a199dd"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "d6afeb9fd01e1e2182f9431cf2a58aa1"
server_key_iv: "9c9e55517973bde47a79167c7746395c"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:34.468463 32589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:34.500898 32589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:34.503378 32589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:34.503607 32589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:34.503932 32589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:34.504379 32589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:34.504433 32589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.504479 32589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:34.504510 32589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.512912 32589 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:46653
I20260807 06:45:34.513491 32589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:45:34.516686 315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:46653 every 8 connection(s)
I20260807 06:45:34.520718 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 32589
I20260807 06:45:34.521030 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.137.148:44845/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:36953
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:39035
--webserver_port=38385
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:34.526880 32586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.517862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:52167 (local address 127.11.137.190:39035)
0807 06:45:34.517940 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:34.517942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:34.517955 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:45:34.518521 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:34.518523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:34.518536 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:34.518599 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:34.519188 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.519968 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.521056 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.521377 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.521491 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.523862 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:34.523863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:34.523864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:34.523872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:34.525342 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.525833 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.525835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.525835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.525908 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.526188 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.526189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.526189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.526319 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:34.526405 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:34.526696 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:45:34.526786 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:45:34.527271 320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.517598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39035 (local address 127.11.137.130:52167)
0807 06:45:34.517794 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:34.517835 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:34.518395 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:34.518675 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:34.518678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:34.518876 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:34.519083 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:34.519088 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.520080 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.520082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:34.520944 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:34.520947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.521524 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.521526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:34.521645 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.522279 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:34.522289 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:34.523756 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:34.525474 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:34.525482 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:34.525484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:34.525727 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:34.525985 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:34.525986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:34.525986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:34.526110 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:34.526395 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:34.526402 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:34.526560 (+ 158us) client_negotiation.cc:769] Sending connection context
0807 06:45:34.526674 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:45:34.526819 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260807 06:45:34.527784 318 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39035
I20260807 06:45:34.527910 318 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.528107 318 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
W20260807 06:45:34.528821 318 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:39035 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:45:34.528919 318 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.529000 318 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:34.529353 318 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.529430 318 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
W20260807 06:45:34.529744 318 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:45:34.649130 321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:34.649452 321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:34.649511 321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:34.651307 321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:34.651373 321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:34.651415 321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:45:34.653729 321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.137.148:44845/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:36953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=38385
--tserver_master_addrs=127.11.137.190:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:34.653954 321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:34.654229 321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:34.661245 333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.661273 331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:34.661964 337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:34.662513 321 server_base.cc:1034] running on GCE node
I20260807 06:45:34.662791 321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:34.663087 321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:34.666132 321 hybrid_clock.cc:648] HybridClock initialized: now 1786085134666112 us; error 31 us; skew 500 ppm
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:34.673738 321 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:45:34.676687 321 webserver.cc:460] Webserver started at http://127.11.137.131:38385/ using document root <none> and password file <none>
I20260807 06:45:34.677042 321 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:34.677147 321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:34.707669 321 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.001s sys 0.000s
I20260807 06:45:34.708496 350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.708753 321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:34.708884 321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "9b072b2944364b5397c91603cb989519"
format_stamp: "Formatted at 2026-08-07 06:45:33 on dist-test-slave-8hhm"
server_key: "0abfcb2e7be88b700ff5fff4e221c6be"
server_key_iv: "e9946426da18f20723274318dadbf9a8"
server_key_version: "kuduclusterkey@0"
I20260807 06:45:34.709528 321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:34.733771 321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:34.736406 321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:34.736637 321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:34.736951 321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:34.737517 321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:34.737622 321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.737722 321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:34.737788 321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:34.744767 321 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:36953
I20260807 06:45:34.745503 321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:45:34.747754 513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:36953 every 8 connection(s)
I20260807 06:45:34.749043 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 321
Aug 07 06:45:34 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085134, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:34.763891 522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.749612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34932 (local address 127.11.137.190:39035)
0807 06:45:34.749744 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:34.749746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:34.754573 (+ 4827us) server_negotiation.cc:407] Connection header received
0807 06:45:34.754599 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:34.754600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:34.754611 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:34.754664 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:34.755484 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.756301 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.757462 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.757771 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.757819 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.759480 (+ 1661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:34.759482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:34.759482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:34.759489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:34.761839 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.763027 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.763028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.763028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.763098 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.763343 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.763344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.763344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.763476 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:34.763660 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:34.763711 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 06:45:34.763790 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":92,"threads_started":1}
I20260807 06:45:34.764336 32586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.748884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:49871 (local address 127.11.137.190:39035)
0807 06:45:34.748943 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:34.748946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:34.753577 (+ 4631us) server_negotiation.cc:407] Connection header received
0807 06:45:34.754296 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:34.754297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:34.754311 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:34.754410 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:34.755697 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.756431 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.757981 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.758314 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.758363 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.760900 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:34.760902 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:34.760902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:34.760909 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:34.762672 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.763099 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.763101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.763101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.763169 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:34.763489 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:34.763490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:34.763490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:34.763590 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:34.763647 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:34.764160 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 06:45:34.764254 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 06:45:34.764899 519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:34.748573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39035 (local address 127.11.137.131:49871)
0807 06:45:34.753402 (+ 4829us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:34.753459 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:34.754163 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:34.754578 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:34.754583 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:34.754847 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:34.755148 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:34.755156 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.756556 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.756557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:34.757842 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:34.757846 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:34.758483 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:34.758485 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:34.758625 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:34.759224 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:34.759235 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:34.760793 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:34.762759 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:34.762765 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:34.762767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:34.763028 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:34.763255 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:34.763256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:34.763256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:34.763410 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:34.763680 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:34.763687 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:34.763843 (+ 156us) client_negotiation.cc:769] Sending connection context
0807 06:45:34.764577 (+ 734us) client_negotiation.cc:240] Negotiation successful
0807 06:45:34.764733 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4772,"thread_start_us":94,"threads_started":1}
I20260807 06:45:34.765416 514 heartbeater.cc:347] Connected to a master server at 127.11.137.190:39035
I20260807 06:45:34.765542 514 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.765738 514 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
W20260807 06:45:34.766445 514 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:39035 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:45:34.766530 514 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.766615 514 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:34.766897 514 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:34.766971 514 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
W20260807 06:45:34.767242 514 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 06:45:35 dist-test-slave-8hhm krb5kdc[30685](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085135, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:35.316028 32583 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:35.316200 32583 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:35.316612 32274 ts_manager.cc:194] Registered new tserver with Master: 5b05cbb05d2646b68f948f2771074d9f (127.11.137.129:39603)
I20260807 06:45:35.317400 32274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:33183
I20260807 06:45:35.529938 318 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:35.530097 318 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:35.530382 32274 ts_manager.cc:194] Registered new tserver with Master: 2a62085dd4824ec987d901d340a199dd (127.11.137.130:46653)
I20260807 06:45:35.530925 32274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:52167
Aug 07 06:45:35 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085135, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:35.767431 514 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:35.767582 514 heartbeater.cc:511] Master 127.11.137.190:39035 requested a full tablet report, sending...
I20260807 06:45:35.767854 32274 ts_manager.cc:194] Registered new tserver with Master: 9b072b2944364b5397c91603cb989519 (127.11.137.131:36953)
I20260807 06:45:35.768399 32274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:49871
I20260807 06:45:35.774427 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:45:35.788332 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.775669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.11.137.190:39035)
0807 06:45:35.777969 (+ 2300us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:35.777971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:35.777987 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:45:35.778027 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:35.778028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:35.778041 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:35.778108 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:35.779108 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.782010 (+ 2902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.783047 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.783329 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.783404 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.784918 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:35.784919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:35.784920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:35.784927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:35.786747 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:35.787160 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:35.787161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:35.787161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:35.787223 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:35.787441 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:35.787442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:35.787442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:35.787596 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:35.787695 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:35.788153 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 06:45:35.788235 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2276,"thread_start_us":80,"threads_started":1}
I20260807 06:45:35.790407 32274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:45:35.792742 32274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:45:35.805872 567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.797072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:46653 (local address 127.0.0.1:56240)
0807 06:45:35.799763 (+ 2691us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:35.799772 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:35.799816 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:35.802038 (+ 2222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:35.802039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:35.802041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:35.802158 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:35.802160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.803245 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.803246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:35.804352 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:35.804355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.805562 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.805563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:35.805649 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.805664 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:45:35.805732 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:45:35.805780 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2675,"thread_start_us":101,"threads_started":1}
I20260807 06:45:35.806468 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.797378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56240 (local address 127.11.137.130:46653)
0807 06:45:35.798298 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:35.798303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:35.799873 (+ 1570us) server_negotiation.cc:407] Connection header received
0807 06:45:35.799909 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:35.799912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:35.799927 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:35.800005 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:35.802249 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.803150 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.804470 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.805476 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.805562 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.805623 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:35.806322 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 06:45:35.806361 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":887,"thread_start_us":60,"threads_started":1}
I20260807 06:45:35.807345 32682 tablet_service.cc:1467] Processing CreateTablet for tablet daf3ae00b7764cc88aa5258539c6357f (DEFAULT_TABLE table=test-table [id=f247028c09e44431aec0b60d2832981c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:35.807744 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.796844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:36953 (local address 127.0.0.1:51422)
0807 06:45:35.798481 (+ 1637us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:35.798492 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:35.798545 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:35.798877 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:35.798880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:35.798883 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:35.798947 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:35.798949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.801025 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.801026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:35.806214 (+ 5188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:35.806217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.807514 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.807515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:35.807576 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.807580 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:45:35.807630 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 06:45:35.807671 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1596,"thread_start_us":107,"threads_started":1}
I20260807 06:45:35.807763 32682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf3ae00b7764cc88aa5258539c6357f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:35.808414 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.797526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51422 (local address 127.11.137.131:36953)
0807 06:45:35.798370 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:35.798373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:35.798601 (+ 228us) server_negotiation.cc:407] Connection header received
0807 06:45:35.798640 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:35.798642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:35.798659 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:35.798725 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:35.799046 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.800913 (+ 1867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.806311 (+ 5398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.807346 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.807421 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.807476 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:35.808249 (+ 773us) server_negotiation.cc:299] Negotiation successful
0807 06:45:35.808296 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":51,"threads_started":1}
I20260807 06:45:35.809289 418 tablet_service.cc:1467] Processing CreateTablet for tablet daf3ae00b7764cc88aa5258539c6357f (DEFAULT_TABLE table=test-table [id=f247028c09e44431aec0b60d2832981c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:35.809731 418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf3ae00b7764cc88aa5258539c6357f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:35.814536 573 tablet_bootstrap.cc:492] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Bootstrap starting.
I20260807 06:45:35.815894 573 tablet_bootstrap.cc:654] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:35.816632 573 log.cc:824] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:35.817538 572 tablet_bootstrap.cc:492] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Bootstrap starting.
I20260807 06:45:35.818500 572 tablet_bootstrap.cc:654] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:35.818835 572 log.cc:824] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:35.819869 572 tablet_bootstrap.cc:492] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: No bootstrap required, opened a new log
I20260807 06:45:35.819947 572 ts_tablet_manager.cc:1397] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:45:35.820194 569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.796478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:39603 (local address 127.0.0.1:58716)
0807 06:45:35.798015 (+ 1537us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:35.798055 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:35.798119 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:35.815620 (+ 17501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:35.815621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:35.815624 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:35.815668 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:35.815670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.817134 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.817135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:35.818503 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:35.818507 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.819841 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.819842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:35.819909 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.819968 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 06:45:35.820078 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:45:35.820120 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1467,"thread_start_us":204,"threads_started":1}
I20260807 06:45:35.820750 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:35.796597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58716 (local address 127.11.137.129:39603)
0807 06:45:35.814882 (+ 18285us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:35.814888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:35.814901 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:45:35.815430 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:35.815433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:35.815465 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:35.815750 (+ 285us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:35.815866 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.817033 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.818709 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:35.819639 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:35.819745 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:35.819803 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:35.820596 (+ 793us) server_negotiation.cc:299] Negotiation successful
0807 06:45:35.820652 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18240,"thread_start_us":57,"threads_started":1}
I20260807 06:45:35.821406 573 tablet_bootstrap.cc:492] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: No bootstrap required, opened a new log
I20260807 06:45:35.821568 573 ts_tablet_manager.cc:1397] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260807 06:45:35.821645 32483 tablet_service.cc:1467] Processing CreateTablet for tablet daf3ae00b7764cc88aa5258539c6357f (DEFAULT_TABLE table=test-table [id=f247028c09e44431aec0b60d2832981c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:35.822068 32483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf3ae00b7764cc88aa5258539c6357f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:35.824339 572 raft_consensus.cc:348] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:35.824597 572 raft_consensus.cc:374] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:35.824646 572 raft_consensus.cc:729] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a62085dd4824ec987d901d340a199dd, State: Initialized, Role: FOLLOWER
I20260807 06:45:35.824777 572 consensus_queue.cc:260] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:35.825135 572 ts_tablet_manager.cc:1428] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 06:45:35.825284 318 heartbeater.cc:503] Master 127.11.137.190:39035 was elected leader, sending a full tablet report...
I20260807 06:45:35.826037 573 raft_consensus.cc:348] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:35.826267 573 raft_consensus.cc:374] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:35.826359 573 raft_consensus.cc:729] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b072b2944364b5397c91603cb989519, State: Initialized, Role: FOLLOWER
I20260807 06:45:35.826574 573 consensus_queue.cc:260] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:35.826973 573 ts_tablet_manager.cc:1428] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 06:45:35.827009 514 heartbeater.cc:503] Master 127.11.137.190:39035 was elected leader, sending a full tablet report...
I20260807 06:45:35.831908 585 tablet_bootstrap.cc:492] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: Bootstrap starting.
I20260807 06:45:35.833042 585 tablet_bootstrap.cc:654] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:35.833694 585 log.cc:824] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:35.834616 585 tablet_bootstrap.cc:492] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: No bootstrap required, opened a new log
I20260807 06:45:35.834687 585 ts_tablet_manager.cc:1397] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:45:35.839318 585 raft_consensus.cc:348] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:35.839481 585 raft_consensus.cc:374] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:35.839514 585 raft_consensus.cc:729] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b05cbb05d2646b68f948f2771074d9f, State: Initialized, Role: FOLLOWER
I20260807 06:45:35.839634 585 consensus_queue.cc:260] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:35.840000 585 ts_tablet_manager.cc:1428] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260807 06:45:35.840173 32583 heartbeater.cc:503] Master 127.11.137.190:39035 was elected leader, sending a full tablet report...
W20260807 06:45:35.997303 516 tablet.cc:2369] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:45:36.018388 319 tablet.cc:2369] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:45:36.020761 586 raft_consensus.cc:482] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:36.020915 586 raft_consensus.cc:504] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:36.021500 586 leader_election.cc:288] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b05cbb05d2646b68f948f2771074d9f (127.11.137.129:39603), 2a62085dd4824ec987d901d340a199dd (127.11.137.130:46653)
I20260807 06:45:36.025836 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:36.021941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:52195 (local address 127.11.137.129:39603)
0807 06:45:36.021984 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:36.021986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:36.022408 (+ 422us) server_negotiation.cc:407] Connection header received
0807 06:45:36.022513 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:36.022514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:36.022523 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:36.022562 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:36.022846 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.023549 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.024909 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.025482 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.025529 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:36.025537 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:36.025732 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 06:45:36.025768 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:45:36.026065 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:36.021665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:39603 (local address 127.11.137.131:52195)
0807 06:45:36.022319 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:36.022330 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:36.022438 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:36.022633 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:36.022634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:36.022636 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:36.022763 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:36.022765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.023647 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.023648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:36.024809 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:36.024812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.025603 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.025604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:36.025658 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:36.025661 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:45:36.025951 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 06:45:36.025993 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":171,"threads_started":1}
I20260807 06:45:36.026472 32511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf3ae00b7764cc88aa5258539c6357f" candidate_uuid: "9b072b2944364b5397c91603cb989519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b05cbb05d2646b68f948f2771074d9f" is_pre_election: true
I20260807 06:45:36.026741 32511 raft_consensus.cc:2454] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b072b2944364b5397c91603cb989519 in term 0.
I20260807 06:45:36.027064 353 leader_election.cc:302] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b05cbb05d2646b68f948f2771074d9f, 9b072b2944364b5397c91603cb989519; no voters:
I20260807 06:45:36.027201 586 raft_consensus.cc:2781] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:45:36.027241 586 raft_consensus.cc:482] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:45:36.027263 586 raft_consensus.cc:3037] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:36.028458 586 raft_consensus.cc:504] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:36.028591 586 leader_election.cc:288] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [CANDIDATE]: Term 1 election: Requested vote from peers 5b05cbb05d2646b68f948f2771074d9f (127.11.137.129:39603), 2a62085dd4824ec987d901d340a199dd (127.11.137.130:46653)
I20260807 06:45:36.029000 32511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf3ae00b7764cc88aa5258539c6357f" candidate_uuid: "9b072b2944364b5397c91603cb989519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b05cbb05d2646b68f948f2771074d9f"
I20260807 06:45:36.029079 32511 raft_consensus.cc:3037] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:36.029438 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:36.021920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:34789 (local address 127.11.137.130:46653)
0807 06:45:36.021974 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:36.021976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:36.026309 (+ 4333us) server_negotiation.cc:407] Connection header received
0807 06:45:36.026398 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:36.026399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:36.026409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:36.026436 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:36.026599 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.027268 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.028459 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.029044 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.029093 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:36.029100 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:36.029327 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 06:45:36.029370 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 06:45:36.029644 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:36.021722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:46653 (local address 127.11.137.131:34789)
0807 06:45:36.026262 (+ 4540us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:36.026271 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:36.026333 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:36.026493 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:36.026494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:36.026495 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:36.026521 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:36.026522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.027360 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.027361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:36.028359 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:36.028362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.029160 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.029161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:36.029248 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:36.029251 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:45:36.029549 (+ 298us) client_negotiation.cc:240] Negotiation successful
0807 06:45:36.029585 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4529,"thread_start_us":390,"threads_started":1}
I20260807 06:45:36.030292 32511 raft_consensus.cc:2454] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b072b2944364b5397c91603cb989519 in term 1.
I20260807 06:45:36.030841 32719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf3ae00b7764cc88aa5258539c6357f" candidate_uuid: "9b072b2944364b5397c91603cb989519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a62085dd4824ec987d901d340a199dd" is_pre_election: true
I20260807 06:45:36.030992 32719 raft_consensus.cc:2454] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b072b2944364b5397c91603cb989519 in term 0.
I20260807 06:45:36.031167 32717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf3ae00b7764cc88aa5258539c6357f" candidate_uuid: "9b072b2944364b5397c91603cb989519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a62085dd4824ec987d901d340a199dd"
I20260807 06:45:36.031244 32717 raft_consensus.cc:3037] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:36.031266 353 leader_election.cc:302] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b05cbb05d2646b68f948f2771074d9f, 9b072b2944364b5397c91603cb989519; no voters:
I20260807 06:45:36.031414 586 raft_consensus.cc:2781] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:36.031625 586 raft_consensus.cc:686] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 1 LEADER]: Becoming Leader. State: Replica: 9b072b2944364b5397c91603cb989519, State: Running, Role: LEADER
I20260807 06:45:36.031735 586 consensus_queue.cc:237] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } }
I20260807 06:45:36.032367 32717 raft_consensus.cc:2454] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b072b2944364b5397c91603cb989519 in term 1.
I20260807 06:45:36.032677 32274 catalog_manager.cc:5495] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b072b2944364b5397c91603cb989519 (127.11.137.131). New cstate: current_term: 1 leader_uuid: "9b072b2944364b5397c91603cb989519" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b072b2944364b5397c91603cb989519" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 36953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 } health_report { overall_health: UNKNOWN } } }
W20260807 06:45:36.051311 32584 tablet.cc:2369] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:45:36 dist-test-slave-8hhm krb5kdc[30685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085135, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for HTTP/127.11.137.148@KRBTEST.COM
I20260807 06:45:36.087877 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:36.084539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51424 (local address 127.11.137.131:36953)
0807 06:45:36.084580 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:36.084582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:36.084611 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:45:36.084698 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:36.084699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:36.084725 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:36.084802 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:45:36.085019 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.085730 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.086806 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:36.087113 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:36.087179 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:36.087407 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:45:36.087542 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:45:36.087619 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:36.087775 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 06:45:36.087796 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:45:36.092191 32717 raft_consensus.cc:1261] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 1 FOLLOWER]: Refusing update from remote peer 9b072b2944364b5397c91603cb989519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:36.092191 32511 raft_consensus.cc:1261] T daf3ae00b7764cc88aa5258539c6357f P 5b05cbb05d2646b68f948f2771074d9f [term 1 FOLLOWER]: Refusing update from remote peer 9b072b2944364b5397c91603cb989519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:36.092621 593 consensus_queue.cc:1035] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b05cbb05d2646b68f948f2771074d9f" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:36.092875 586 consensus_queue.cc:1035] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a62085dd4824ec987d901d340a199dd" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 46653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:36.098519 599 mvcc.cc:205] Tried to move back new op lower bound from 7315804717427687424 to 7315804717186400256. Current Snapshot: MvccSnapshot[applied={T|T < 7315804717427687424}]
I20260807 06:45:36.099212 604 mvcc.cc:205] Tried to move back new op lower bound from 7315804717427687424 to 7315804717186400256. Current Snapshot: MvccSnapshot[applied={T|T < 7315804717427687424}]
I20260807 06:45:36.103302 603 mvcc.cc:205] Tried to move back new op lower bound from 7315804717427687424 to 7315804717186400256. Current Snapshot: MvccSnapshot[applied={T|T < 7315804717427687424}]
I20260807 06:45:36.104264 32273 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:45:36.104393 32273 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:45:36.105156 32273 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa0f93845e214e9baef33187fb64fd7f: Sending DeleteTablet for 3 replicas of tablet daf3ae00b7764cc88aa5258539c6357f
I20260807 06:45:36.105711 32483 tablet_service.cc:1514] Processing DeleteTablet for tablet daf3ae00b7764cc88aa5258539c6357f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:36 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:58716
I20260807 06:45:36.106096 418 tablet_service.cc:1514] Processing DeleteTablet for tablet daf3ae00b7764cc88aa5258539c6357f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:36 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:51422
I20260807 06:45:36.106470 32682 tablet_service.cc:1514] Processing DeleteTablet for tablet daf3ae00b7764cc88aa5258539c6357f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:36 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:56240
I20260807 06:45:36.106825 623 tablet_replica.cc:330] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: stopping tablet replica
I20260807 06:45:36.107223 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 32337
I20260807 06:45:36.137408 623 raft_consensus.cc:2229] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:45:36.137684 623 raft_consensus.cc:2258] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:36.139302 623 ts_tablet_manager.cc:1905] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:36.141942 623 ts_tablet_manager.cc:1918] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:36.142021 623 log.cc:1196] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/daf3ae00b7764cc88aa5258539c6357f
I20260807 06:45:36.142318 623 ts_tablet_manager.cc:1939] T daf3ae00b7764cc88aa5258539c6357f P 2a62085dd4824ec987d901d340a199dd: Deleting consensus metadata
I20260807 06:45:36.142807 32259 catalog_manager.cc:4841] TS 2a62085dd4824ec987d901d340a199dd (127.11.137.130:46653): tablet daf3ae00b7764cc88aa5258539c6357f (table test-table [id=f247028c09e44431aec0b60d2832981c]) successfully deleted
I20260807 06:45:36.146250 622 tablet_replica.cc:330] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: stopping tablet replica
I20260807 06:45:36.146406 622 raft_consensus.cc:2229] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:45:36.146528 622 raft_consensus.cc:2258] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:36.153725 622 ts_tablet_manager.cc:1905] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:36.157280 622 ts_tablet_manager.cc:1918] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:36.157368 622 log.cc:1196] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/daf3ae00b7764cc88aa5258539c6357f
I20260807 06:45:36.157649 622 ts_tablet_manager.cc:1939] T daf3ae00b7764cc88aa5258539c6357f P 9b072b2944364b5397c91603cb989519: Deleting consensus metadata
I20260807 06:45:36.158119 32259 catalog_manager.cc:4841] TS 9b072b2944364b5397c91603cb989519 (127.11.137.131:36953): tablet daf3ae00b7764cc88aa5258539c6357f (table test-table [id=f247028c09e44431aec0b60d2832981c]) successfully deleted
W20260807 06:45:36.161419 32258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:39603 (error 108)
I20260807 06:45:36.163951 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 32589
I20260807 06:45:36.177977 569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:36.177793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:39603 (local address 127.0.0.1:58718)
0807 06:45:36.177868 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:36.177924 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:39603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 06:45:36.178342 32258 catalog_manager.cc:4584] TS 5b05cbb05d2646b68f948f2771074d9f (127.11.137.129:39603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet daf3ae00b7764cc88aa5258539c6357f: Network error: Client connection negotiation failed: client connection to 127.11.137.129:39603: connect: Connection refused (error 111)
I20260807 06:45:36.211194 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 321
I20260807 06:45:36.222024 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 32228
I20260807 06:45:36.237720 11814 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 06:45:36.582625 11814 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 06:45:36.582716 11814 mini_ranger.cc:66] Stopping Ranger...
I20260807 06:45:36.938326 11814 mini_ranger.cc:68] Stopped Ranger
2026-08-07 06:45:36.938 UTC [30731] LOG: received smart shutdown request
2026-08-07 06:45:36.943 UTC [30731] LOG: background worker "logical replication launcher" (PID 30749) exited with exit code 1
2026-08-07 06:45:36.944 UTC [30736] LOG: shutting down
2026-08-07 06:45:37.110 UTC [30731] LOG: database system is shut down
2026-08-07T06:45:37Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48427 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:45:37 dist-test-slave-8hhm krb5kdc[641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:45:37 dist-test-slave-8hhm krb5kdc[641](info): set up 2 sockets
Aug 07 06:45:37 dist-test-slave-8hhm krb5kdc[641](info): commencing operation
krb5kdc: starting...
W20260807 06:45:38.489609 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:45:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:45:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:45:38.616613 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:37303
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:36999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:37303,127.11.137.189:43131,127.11.137.188:33459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:38.698882 656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:38.699084 656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:38.699107 656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:38.700282 656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:38.700325 656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:38.700340 656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:38.700377 656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:38.700409 656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:38.701910 656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:37303,127.11.137.189:43131,127.11.137.188:33459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:37303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:38.702172 656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:38.702430 656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:38.707458 670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:38.707494 667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:38.707461 668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:38.707769 656 server_base.cc:1034] running on GCE node
I20260807 06:45:38.708052 656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:38.708308 656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:38.709470 656 hybrid_clock.cc:648] HybridClock initialized: now 1786085138709457 us; error 47 us; skew 500 ppm
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:38.712109 656 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:38.712534 656 webserver.cc:460] Webserver started at http://127.11.137.190:41829/ using document root <none> and password file <none>
I20260807 06:45:38.712787 656 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:38.712858 656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:38.713004 656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:38.714139 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "db870785305846c0a1b165e3df5f94b7"
format_stamp: "Formatted at 2026-08-07 06:45:38 on dist-test-slave-8hhm"
server_key: "b1bd8897df2063b2aea7aeb3760f2afe"
server_key_iv: "d22722511a3f383fcfb998647e2596ec"
server_key_version: "encryptionkey@0"
I20260807 06:45:38.714511 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "db870785305846c0a1b165e3df5f94b7"
format_stamp: "Formatted at 2026-08-07 06:45:38 on dist-test-slave-8hhm"
server_key: "b1bd8897df2063b2aea7aeb3760f2afe"
server_key_iv: "d22722511a3f383fcfb998647e2596ec"
server_key_version: "encryptionkey@0"
I20260807 06:45:38.715848 656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:45:38.716563 681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:38.716729 656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:45:38.716840 656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "db870785305846c0a1b165e3df5f94b7"
format_stamp: "Formatted at 2026-08-07 06:45:38 on dist-test-slave-8hhm"
server_key: "b1bd8897df2063b2aea7aeb3760f2afe"
server_key_iv: "d22722511a3f383fcfb998647e2596ec"
server_key_version: "encryptionkey@0"
I20260807 06:45:38.716917 656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:38.730322 656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:38.732156 656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:38.732319 656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:38.736513 656 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:37303
I20260807 06:45:38.736548 766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:37303 every 8 connection(s)
I20260807 06:45:38.736923 656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:38.737867 768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:38.739473 768 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:45:38.741760 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 656
I20260807 06:45:38.741882 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:45:38.742093 11814 external_mini_cluster.cc:1428] Setting key 9b97a2bdf50a4998848d84995c2500d4
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:38.750216 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.740196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:37303 (local address 127.0.0.1:57196)
0807 06:45:38.740367 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.740417 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:38.740867 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:38.741166 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:38.741168 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:38.741502 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:38.741677 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.741682 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.743193 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.743194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.743861 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.743863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.744397 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.744398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.744460 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.745035 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:38.745043 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:38.746482 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:38.748695 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.748702 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.748704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.748888 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.749157 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.749157 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.749158 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.749313 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.749771 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:38.749777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:38.749835 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 06:45:38.749906 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 06:45:38.750053 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
I20260807 06:45:38.750311 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.740250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57196 (local address 127.11.137.190:37303)
0807 06:45:38.740443 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:38.740447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:38.740492 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:45:38.741012 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:38.741014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:38.741032 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:38.741108 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:38.741790 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.743088 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.743966 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.744297 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.744423 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.746570 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:38.746580 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:38.746580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:38.746589 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:38.748595 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.748974 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.748978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.748978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.749083 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.749383 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.749384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.749384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.749692 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:38.749786 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:38.749985 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 06:45:38.750138 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260807 06:45:38.751075 768 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.137.189@KRBTEST.COM; defaulting to no policy
I20260807 06:45:38.751466 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.751325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42460)
0807 06:45:38.751400 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.751441 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 06:45:38.751643 682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
I20260807 06:45:38.752100 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.751979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42464)
0807 06:45:38.752044 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.752080 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 06:45:38.752251 768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:43131: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab.
Entry for principal kudu/127.11.137.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab.
I20260807 06:45:38.772287 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:43131
--webserver_interface=127.11.137.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab
--principal=kudu/127.11.137.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:36999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:37303,127.11.137.189:43131,127.11.137.188:33459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:38.801563 768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } attempt: 1
I20260807 06:45:38.802078 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.801933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42466)
0807 06:45:38.801999 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.802039 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 06:45:38.802536 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.802429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42478)
0807 06:45:38.802477 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.802518 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 06:45:38.802676 768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:43131: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
W20260807 06:45:38.856600 781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:38.856851 781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:38.856889 781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:38.858168 781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:38.858244 781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:38.858268 781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:38.858289 781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:38.858319 781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:38.859753 781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:37303,127.11.137.189:43131,127.11.137.188:33459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab
--principal=kudu/127.11.137.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.137.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:38.860033 781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:38.860260 781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:38.865154 797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:38.865183 794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:38.865262 781 server_base.cc:1034] running on GCE node
W20260807 06:45:38.865163 791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:38.865761 781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:38.866076 781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:38.867241 781 hybrid_clock.cc:648] HybridClock initialized: now 1786085138867229 us; error 40 us; skew 500 ppm
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:38.869846 781 init.cc:377] Logged in from keytab as kudu/127.11.137.189@KRBTEST.COM (short username kudu)
I20260807 06:45:38.870332 781 webserver.cc:460] Webserver started at http://127.11.137.189:32839/ using document root <none> and password file <none>
I20260807 06:45:38.870558 781 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:38.870626 781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:38.870779 781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:38.870824 768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } attempt: 2
I20260807 06:45:38.871234 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.871128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42488)
0807 06:45:38.871173 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.871207 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 06:45:38.871589 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.871488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42492)
0807 06:45:38.871536 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.871569 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 06:45:38.871680 768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:43131: Network error: Client connection negotiation failed: client connection to 127.11.137.189:43131: connect: Connection refused (error 111)
I20260807 06:45:38.872076 781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data/instance:
uuid: "c08683c1c0bb4f32a196bf07b733e089"
format_stamp: "Formatted at 2026-08-07 06:45:38 on dist-test-slave-8hhm"
server_key: "9436638d26fc72afc091943dc58f1c48"
server_key_iv: "e20fd887a7c0c8775c5c7614fcbf36a3"
server_key_version: "encryptionkey@0"
I20260807 06:45:38.872445 781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal/instance:
uuid: "c08683c1c0bb4f32a196bf07b733e089"
format_stamp: "Formatted at 2026-08-07 06:45:38 on dist-test-slave-8hhm"
server_key: "9436638d26fc72afc091943dc58f1c48"
server_key_iv: "e20fd887a7c0c8775c5c7614fcbf36a3"
server_key_version: "encryptionkey@0"
I20260807 06:45:38.873991 781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:45:38.874780 807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:38.874969 781 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:38.875074 781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal
uuid: "c08683c1c0bb4f32a196bf07b733e089"
format_stamp: "Formatted at 2026-08-07 06:45:38 on dist-test-slave-8hhm"
server_key: "9436638d26fc72afc091943dc58f1c48"
server_key_iv: "e20fd887a7c0c8775c5c7614fcbf36a3"
server_key_version: "encryptionkey@0"
I20260807 06:45:38.875157 781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:38.901364 781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:38.903755 781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:38.903963 781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:38.908411 781 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.189:43131
I20260807 06:45:38.908456 885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.189:43131 every 8 connection(s)
I20260807 06:45:38.908859 781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
I20260807 06:45:38.909883 887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:38.911569 887 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:38.918335 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 781
I20260807 06:45:38.918457 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-1/wal/instance
I20260807 06:45:38.918653 11814 external_mini_cluster.cc:1428] Setting key be1c49a70cd65885eabbbe17efa53662
I20260807 06:45:38.921644 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.912337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57206 (local address 127.11.137.190:37303)
0807 06:45:38.912436 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:38.912439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:38.912640 (+ 201us) server_negotiation.cc:407] Connection header received
0807 06:45:38.913235 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:38.913237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:38.913254 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:38.913355 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:38.914048 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.914575 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.915709 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.915945 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.916047 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.918428 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:38.918429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:38.918430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:38.918439 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:38.920077 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.920532 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.920534 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.920534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.920609 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.920890 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.920891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.920891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.921015 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:38.921093 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:38.921447 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 06:45:38.921551 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:45:38.921883 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.912260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:37303 (local address 127.0.0.1:57206)
0807 06:45:38.912501 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.912542 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:38.913100 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:38.913453 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:38.913457 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:38.913738 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:38.913936 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.913941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.914698 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.914700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.915603 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.915605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.916062 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.916064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.916200 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.916679 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:38.916698 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:38.918309 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:38.920170 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.920179 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.920181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.920456 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.920683 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.920684 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.920684 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.920805 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.921097 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:38.921106 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:38.921301 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 06:45:38.921425 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 06:45:38.921587 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260807 06:45:38.922681 887 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.137.188@KRBTEST.COM; defaulting to no policy
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.188@KRBTEST.COM" created.
I20260807 06:45:38.930534 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.922963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42494)
0807 06:45:38.923226 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.923238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:38.923294 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:38.923444 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:38.923444 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:38.923605 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:38.923650 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.923651 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.924608 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.924609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.925142 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.925143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.925681 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.925682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.925756 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.926243 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:38.926250 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:38.927602 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:38.929459 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.929460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.929460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.929625 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.929845 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.929846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.929846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.929899 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.930136 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:38.930136 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:38.930183 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:45:38.930238 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 06:45:38.930363 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251}
I20260807 06:45:38.930670 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.923071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42494 (local address 127.11.137.189:43131)
0807 06:45:38.923236 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:38.923242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:38.923293 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:45:38.923357 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:38.923360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:38.923374 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:38.923445 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:38.923743 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.924501 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.925248 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.925581 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.925680 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.927702 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:38.927711 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:38.927711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:38.927717 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:38.929382 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.929719 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.929722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.929722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.929785 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.929947 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.929947 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.929948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.930080 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:38.930138 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:38.930294 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 06:45:38.930479 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260807 06:45:38.931280 887 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:45:38.931619 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.931499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59274)
0807 06:45:38.931548 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.931592 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 06:45:38.931779 814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
I20260807 06:45:38.932174 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.932083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59290)
0807 06:45:38.932129 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.932153 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 06:45:38.932368 887 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:33459: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab.
Entry for principal kudu/127.11.137.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab.
I20260807 06:45:38.946708 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:33459
--webserver_interface=127.11.137.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab
--principal=kudu/127.11.137.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:36999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:37303,127.11.137.189:43131,127.11.137.188:33459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:38.962836 768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } attempt: 3
Aug 07 06:45:38 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:45:38.970194 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.963336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42510 (local address 127.11.137.189:43131)
0807 06:45:38.963408 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:38.963410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:38.963421 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:45:38.963473 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:38.963474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:38.963489 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:38.963566 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:38.963906 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.964423 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.965145 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.965426 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.965506 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.967398 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:38.967400 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:38.967400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:38.967409 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:38.968901 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.969329 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.969330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.969331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.969400 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:38.969633 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:38.969634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:38.969635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:38.969757 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:38.969837 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:38.970001 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 06:45:38.970091 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:45:38.970199 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.963245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42510)
0807 06:45:38.963311 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.963324 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:38.963406 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:38.963574 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:38.963575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:38.963747 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:38.963813 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.963815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.964524 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.964526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.965054 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:38.965055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:38.965505 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:38.965506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:38.965590 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:38.966084 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:38.966089 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:38.967306 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:38.969021 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.969022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.969023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.969256 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.969479 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:38.969480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:38.969480 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:38.969546 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:38.969829 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:38.969830 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:38.969880 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:45:38.969974 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 06:45:38.970088 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 06:45:38.970593 768 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:45:38.970968 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.970855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59302)
0807 06:45:38.970911 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.970941 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 06:45:38.971302 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.971209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59304)
0807 06:45:38.971255 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.971280 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 06:45:38.971405 768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:33459: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
I20260807 06:45:38.981612 887 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } attempt: 1
I20260807 06:45:38.982096 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.981938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59310)
0807 06:45:38.982020 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.982063 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 06:45:38.982494 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:38.982397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59324)
0807 06:45:38.982444 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:38.982471 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 06:45:38.982614 887 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:33459: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
I20260807 06:45:39.002552 768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } attempt: 1
I20260807 06:45:39.003017 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.002882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59334)
0807 06:45:39.002947 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.002988 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 06:45:39.003393 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.003295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59338)
0807 06:45:39.003341 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.003369 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 06:45:39.003486 768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:33459: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
W20260807 06:45:39.031091 897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:39.031345 897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:39.031384 897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:39.032527 897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:39.032595 897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:39.032620 897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:39.032658 897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:39.032685 897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:39.034257 897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:37303,127.11.137.189:43131,127.11.137.188:33459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab
--principal=kudu/127.11.137.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:33459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.137.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:39.034544 897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:39.034772 897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:39.039710 909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:39.039721 911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:39.039772 897 server_base.cc:1034] running on GCE node
W20260807 06:45:39.039716 906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:39.040160 897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:39.040467 897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:39.041653 897 hybrid_clock.cc:648] HybridClock initialized: now 1786085139041642 us; error 40 us; skew 500 ppm
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085139, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:39.044543 897 init.cc:377] Logged in from keytab as kudu/127.11.137.188@KRBTEST.COM (short username kudu)
I20260807 06:45:39.045128 897 webserver.cc:460] Webserver started at http://127.11.137.188:34799/ using document root <none> and password file <none>
I20260807 06:45:39.045423 897 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:39.045538 897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:39.045717 897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:39.046917 897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data/instance:
uuid: "85405c16cf794b5bbe48e9c9774ef274"
format_stamp: "Formatted at 2026-08-07 06:45:39 on dist-test-slave-8hhm"
server_key: "ac3bd89c3b53bcaeb84c2ae38eba2406"
server_key_iv: "f7e42dd0268e15ae38fcbad3157a8a92"
server_key_version: "encryptionkey@0"
I20260807 06:45:39.047348 897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal/instance:
uuid: "85405c16cf794b5bbe48e9c9774ef274"
format_stamp: "Formatted at 2026-08-07 06:45:39 on dist-test-slave-8hhm"
server_key: "ac3bd89c3b53bcaeb84c2ae38eba2406"
server_key_iv: "f7e42dd0268e15ae38fcbad3157a8a92"
server_key_version: "encryptionkey@0"
I20260807 06:45:39.048851 897 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:45:39.049734 921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:39.049949 897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:45:39.050078 897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal
uuid: "85405c16cf794b5bbe48e9c9774ef274"
format_stamp: "Formatted at 2026-08-07 06:45:39 on dist-test-slave-8hhm"
server_key: "ac3bd89c3b53bcaeb84c2ae38eba2406"
server_key_iv: "f7e42dd0268e15ae38fcbad3157a8a92"
server_key_version: "encryptionkey@0"
I20260807 06:45:39.050163 897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:39.050755 887 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } attempt: 2
I20260807 06:45:39.051172 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.051008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59342)
0807 06:45:39.051079 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.051123 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 06:45:39.051612 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.051464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59358)
0807 06:45:39.051546 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.051578 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 06:45:39.051738 887 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:33459: Network error: Client connection negotiation failed: client connection to 127.11.137.188:33459: connect: Connection refused (error 111)
I20260807 06:45:39.065798 897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:39.068027 897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:39.068186 897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:39.073042 897 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.188:33459
I20260807 06:45:39.073108 1001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.188:33459 every 8 connection(s)
I20260807 06:45:39.073536 897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
I20260807 06:45:39.074424 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:39.075927 1002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:45:39.078627 768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } attempt: 2
I20260807 06:45:39.082129 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 897
I20260807 06:45:39.082261 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786084979847518-11814-0/minicluster-data/master-2/wal/instance
I20260807 06:45:39.082502 11814 external_mini_cluster.cc:1428] Setting key 8611f2b611799684926600c9a4900e2c
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085139, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:45:39.086984 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.076589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57216 (local address 127.11.137.190:37303)
0807 06:45:39.076637 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.076639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.076848 (+ 209us) server_negotiation.cc:407] Connection header received
0807 06:45:39.077416 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.077418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.077430 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.077492 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.078206 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.078732 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.080100 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.080335 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.080409 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.083174 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.083175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.083176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.083183 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.085307 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.085851 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.085853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.085853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.085915 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.086202 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.086203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.086204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.086383 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.086432 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.086797 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.086890 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:45:39.087185 1004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.076538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:37303 (local address 127.0.0.1:57216)
0807 06:45:39.076717 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.076758 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:39.077315 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:39.077575 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:39.077579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:39.077876 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:39.078118 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.078123 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.078840 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.078842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.079997 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.080000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.080454 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.080455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.080657 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.081264 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:39.081273 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:39.083102 (+ 1829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:39.085409 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.085417 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.085419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.085756 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.085975 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.085976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.085976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.086112 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.086484 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:39.086490 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:39.086637 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 06:45:39.086772 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 06:45:39.086935 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260807 06:45:39.087265 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.078911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59366)
0807 06:45:39.078996 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.079006 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:39.079047 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:39.079365 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:39.079366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:39.079549 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:39.079584 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.079593 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.080633 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.080634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.081508 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.081511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.082082 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.082083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.082142 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.082540 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:39.082545 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:39.084042 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:39.085897 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.085898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.085898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.086102 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.086330 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.086331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.086331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.086397 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.086707 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:39.086708 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:39.086752 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 06:45:39.086822 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 06:45:39.087175 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":241}
I20260807 06:45:39.087661 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.078978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59366 (local address 127.11.137.188:33459)
0807 06:45:39.079200 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.079205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.079230 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:45:39.079249 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.079251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.079267 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.079327 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.079690 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.080539 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.081608 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.081984 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.082069 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.084132 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.084140 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.084140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.084147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.085794 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.086187 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.086190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.086190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.086255 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.086467 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.086468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.086468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.086634 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.086725 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.086910 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.087022 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":193,"thread_start_us":164,"threads_started":1}
I20260807 06:45:39.087870 1002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:45:39.089484 768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7: Bootstrap starting.
I20260807 06:45:39.090181 768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:39.090528 768 log.cc:824] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:39.091516 768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7: No bootstrap required, opened a new log
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085139, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:45:39.093272 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.082881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59382 (local address 127.11.137.188:33459)
0807 06:45:39.083031 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.083032 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.083170 (+ 138us) server_negotiation.cc:407] Connection header received
0807 06:45:39.083285 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.083286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.083298 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.083379 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.084122 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.085861 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.086873 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.087189 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.087254 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.090066 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.090068 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.090068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.090075 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.091913 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.092326 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.092327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.092327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.092386 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.092658 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.092659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.092659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.092786 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.092935 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.093033 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.093108 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
I20260807 06:45:39.093920 768 raft_consensus.cc:348] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.094084 768 raft_consensus.cc:374] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:39.094144 768 raft_consensus.cc:729] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db870785305846c0a1b165e3df5f94b7, State: Initialized, Role: FOLLOWER
I20260807 06:45:39.094316 768 consensus_queue.cc:260] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.094696 768 sys_catalog.cc:564] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:39.094662 1012 sys_catalog.cc:455] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.095743 1012 sys_catalog.cc:458] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.096450 1004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.088136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:43131 (local address 127.0.0.1:42512)
0807 06:45:39.088262 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.088272 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:39.088311 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:39.088470 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:39.088471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:39.088634 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:39.088685 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.088686 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.089439 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.089440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.090150 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.090152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.090500 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.090501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.090570 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.091418 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:39.091423 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:39.092843 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:39.095376 (+ 2533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.095377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.095378 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.095570 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.095775 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.095776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.095776 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.095840 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.096130 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:39.096131 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:39.096177 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 06:45:39.096252 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:45:39.096345 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 06:45:39.096510 1031 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:45:39.096557 1031 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:45:39.097137 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.088227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42512 (local address 127.11.137.189:43131)
0807 06:45:39.088294 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.088297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.088307 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:45:39.088385 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.088386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.088396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.088456 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.088773 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.089358 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.090229 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.090429 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.090501 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.092937 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.092938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.092939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.092946 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.095278 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.095650 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.095651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.095652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.095714 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.095895 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.095896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.095897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.096034 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.096105 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.096922 (+ 817us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.097019 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 06:45:39.097501 1002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:39.097872 656 master_runner.cc:186] Error getting master registration for 127.11.137.189:43131: OK, instance_id { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" instance_seqno: 1786085138907154 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:45:39.100905 656 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085139, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:45:39.102988 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.094119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57220 (local address 127.11.137.190:37303)
0807 06:45:39.094188 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.094190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.094198 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:45:39.094218 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.094219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.094228 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.094276 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.094920 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.095622 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.096714 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.096974 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.097015 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.099974 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.099975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.099975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.099982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.101620 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.102004 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.102005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.102005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.102070 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.102305 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.102306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.102306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.102431 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.102577 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.102818 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.102901 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:45:39.105759 1004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.097744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59384)
0807 06:45:39.097812 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.097821 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:39.097853 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:39.098106 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:39.098107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:39.098267 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:39.098302 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.098304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.099276 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.099276 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.099954 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.099956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.101066 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.101067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.101121 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.101539 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:39.101544 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:39.102726 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:39.104638 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.104638 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.104639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.104804 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.105006 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.105007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.105007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.105080 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.105389 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:39.105390 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:39.105438 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 06:45:39.105518 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:45:39.105623 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 06:45:39.106127 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.097850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59384 (local address 127.11.137.188:33459)
0807 06:45:39.097886 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.097888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.097895 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:45:39.097915 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.097915 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.097925 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.097976 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.098386 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.099189 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.100096 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.100661 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.101012 (+ 351us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.102821 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.102822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.102823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.102829 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.104529 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.104889 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.104890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.104891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.104943 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.105154 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.105155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.105156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.105313 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.105381 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.105574 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.105684 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":19}
I20260807 06:45:39.107599 1002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: Bootstrap starting.
I20260807 06:45:39.108467 1002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: Neither blocks nor log segments found. Creating new log.
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:45:39.108789 1002 log.cc:824] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:39.109716 1002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: No bootstrap required, opened a new log
I20260807 06:45:39.111753 1002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.111914 1002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:39.111948 1002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85405c16cf794b5bbe48e9c9774ef274, State: Initialized, Role: FOLLOWER
I20260807 06:45:39.111958 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.104154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42514 (local address 127.11.137.189:43131)
0807 06:45:39.104198 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.104199 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.104208 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:45:39.104232 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.104233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.104241 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.104313 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.104942 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.105667 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.106613 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.106822 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.106893 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.109066 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.109067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.109068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.109077 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.110740 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.111129 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.111131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.111131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.111187 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.111397 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.111398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.111398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.111517 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.111726 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.111765 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.111840 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:45:39.112085 1002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.112390 1002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:39.112361 1035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.112452 1035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.113199 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 06:45:39.114820 1056 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:45:39.114881 1056 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:45:39.115639 897 master_runner.cc:186] Error getting master registration for 127.11.137.189:43131: OK, instance_id { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" instance_seqno: 1786085138907154 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:45:39.117913 897 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:45:39.127482 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.119535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57226 (local address 127.11.137.190:37303)
0807 06:45:39.119602 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.119604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.119795 (+ 191us) server_negotiation.cc:407] Connection header received
0807 06:45:39.119935 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.119936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.119946 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.119976 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.120903 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.121635 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.122628 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.122930 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.122969 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.124539 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.124540 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.124541 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.124548 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.126258 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.126639 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.126640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.126641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.126706 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.126903 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.126904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.126905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.127045 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.127114 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.127309 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.127383 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:45:39.127847 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.120365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42530 (local address 127.11.137.189:43131)
0807 06:45:39.120439 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.120440 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.120447 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:45:39.120468 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.120468 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.120477 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.120550 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.121320 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.122000 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.122997 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.123272 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.123316 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.124768 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.124770 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.124770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.124777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.126456 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.126866 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.126867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.126868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.126924 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.127144 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.127145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.127146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.127265 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.127346 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.127662 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.127750 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:45:39.130389 1012 raft_consensus.cc:482] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:39.130497 1012 raft_consensus.cc:504] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.130779 1012 leader_election.cc:288] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c08683c1c0bb4f32a196bf07b733e089 (127.11.137.189:43131), 85405c16cf794b5bbe48e9c9774ef274 (127.11.137.188:33459)
I20260807 06:45:39.131279 959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db870785305846c0a1b165e3df5f94b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85405c16cf794b5bbe48e9c9774ef274" is_pre_election: true
I20260807 06:45:39.131453 959 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db870785305846c0a1b165e3df5f94b7 in term 0.
I20260807 06:45:39.131662 686 leader_election.cc:302] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85405c16cf794b5bbe48e9c9774ef274, db870785305846c0a1b165e3df5f94b7; no voters:
I20260807 06:45:39.131983 1012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:45:39.132062 1012 raft_consensus.cc:482] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:45:39.132089 1012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:39.133754 1012 raft_consensus.cc:504] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.133886 1012 leader_election.cc:288] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [CANDIDATE]: Term 1 election: Requested vote from peers c08683c1c0bb4f32a196bf07b733e089 (127.11.137.189:43131), 85405c16cf794b5bbe48e9c9774ef274 (127.11.137.188:33459)
I20260807 06:45:39.134342 959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db870785305846c0a1b165e3df5f94b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85405c16cf794b5bbe48e9c9774ef274"
I20260807 06:45:39.134418 959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:39.135310 959 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db870785305846c0a1b165e3df5f94b7 in term 1.
I20260807 06:45:39.135565 686 leader_election.cc:302] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85405c16cf794b5bbe48e9c9774ef274, db870785305846c0a1b165e3df5f94b7; no voters:
I20260807 06:45:39.135684 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.119845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59400 (local address 127.11.137.188:33459)
0807 06:45:39.120410 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.120411 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.123794 (+ 3383us) server_negotiation.cc:407] Connection header received
0807 06:45:39.125042 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.125044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.125056 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.125085 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.128551 (+ 3466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.129312 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.130388 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.130715 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.130785 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.132265 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.132267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.132267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.132274 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.133974 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.134559 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.134560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.134560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.134631 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.134941 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.134942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.134943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.135080 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.135153 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.135496 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.135582 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544}
I20260807 06:45:39.135730 1012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:39.135914 1012 raft_consensus.cc:686] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [term 1 LEADER]: Becoming Leader. State: Replica: db870785305846c0a1b165e3df5f94b7, State: Running, Role: LEADER
I20260807 06:45:39.136003 1012 consensus_queue.cc:237] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.136405 1012 sys_catalog.cc:455] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db870785305846c0a1b165e3df5f94b7. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.136489 1012 sys_catalog.cc:458] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:39.137101 1079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:39.137379 1079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:39.139287 959 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [term 1 FOLLOWER]: Refusing update from remote peer db870785305846c0a1b165e3df5f94b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:39.139660 1076 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:39.141104 1035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db870785305846c0a1b165e3df5f94b7. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.141196 1035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.142724 1012 sys_catalog.cc:455] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.142803 1012 sys_catalog.cc:458] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:39.142894 1035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.142961 1035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.143006 887 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } attempt: 3
I20260807 06:45:39.143601 1081 mvcc.cc:205] Tried to move back new op lower bound from 7315804729911357440 to 7315804729901625344. Current Snapshot: MvccSnapshot[applied={T|T < 7315804729911357440}]
I20260807 06:45:39.144025 1080 mvcc.cc:205] Tried to move back new op lower bound from 7315804729911357440 to 7315804729901625344. Current Snapshot: MvccSnapshot[applied={T|T < 7315804729911357440}]
Aug 07 06:45:39 dist-test-slave-8hhm krb5kdc[641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085138, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:45:39.152310 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.143226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:33459 (local address 127.0.0.1:59414)
0807 06:45:39.143306 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:39.143317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:39.143369 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:39.143700 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:39.143701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:39.143869 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:39.143915 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.143916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.145361 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.145363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.146174 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:39.146177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.146694 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.146695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:39.146750 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.147263 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:39.147268 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:39.149262 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:39.151116 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.151117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.151117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.151351 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.151596 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:39.151597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:39.151597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:39.151677 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:39.151981 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:39.151982 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:39.152041 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 06:45:39.152108 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 06:45:39.152208 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 06:45:39.152689 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:39.143438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59414 (local address 127.11.137.188:33459)
0807 06:45:39.143497 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:39.143499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:39.143507 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:45:39.143528 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:39.143529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:39.143540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:39.143594 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:39.144008 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.144733 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.146275 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:39.146584 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:39.146643 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:39.149345 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:39.149347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:39.149347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:39.149354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:39.151043 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.151451 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.151452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.151452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.151527 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:39.151765 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:39.151766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:39.151766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:39.151927 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:39.151992 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:39.152521 (+ 529us) server_negotiation.cc:299] Negotiation successful
0807 06:45:39.152602 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:45:39.153745 1079 catalog_manager.cc:1347] Generated new cluster ID: 55806f31a59f4ca4a085b6bd81de2fa8
I20260807 06:45:39.153795 1079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:45:39.154672 887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: Bootstrap starting.
I20260807 06:45:39.155424 887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:39.155747 887 log.cc:824] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:39.161913 887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: No bootstrap required, opened a new log
I20260807 06:45:39.164011 887 raft_consensus.cc:348] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.164162 887 raft_consensus.cc:374] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:39.164206 887 raft_consensus.cc:729] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c08683c1c0bb4f32a196bf07b733e089, State: Initialized, Role: FOLLOWER
I20260807 06:45:39.164354 887 consensus_queue.cc:260] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } }
I20260807 06:45:39.164955 850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db870785305846c0a1b165e3df5f94b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c08683c1c0bb4f32a196bf07b733e089"
I20260807 06:45:39.165061 851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db870785305846c0a1b165e3df5f94b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c08683c1c0bb4f32a196bf07b733e089" is_pre_election: true
I20260807 06:45:39.164987 849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:39.166348 849 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [term 1 FOLLOWER]: Refusing update from remote peer db870785305846c0a1b165e3df5f94b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:39.164876 887 sys_catalog.cc:564] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:39.166657 1084 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:45:39.169459 1111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:45:39.169560 1111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:45:39.170855 1079 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:45:39.171327 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.171411 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.171458 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db870785305846c0a1b165e3df5f94b7. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.171496 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.171533 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.171566 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:45:39.171629 1079 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:45:39.175244 1084 sys_catalog.cc:455] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db870785305846c0a1b165e3df5f94b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db870785305846c0a1b165e3df5f94b7" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37303 } } peers { permanent_uuid: "c08683c1c0bb4f32a196bf07b733e089" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 43131 } } peers { permanent_uuid: "85405c16cf794b5bbe48e9c9774ef274" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 33459 } } }
I20260807 06:45:39.175343 1084 sys_catalog.cc:458] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7 [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:39.178038 1099 mvcc.cc:205] Tried to move back new op lower bound from 7315804729911357440 to 7315804729901625344. Current Snapshot: MvccSnapshot[applied={T|T < 7315804729911357440}]
I20260807 06:45:39.185649 1079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db870785305846c0a1b165e3df5f94b7: Generated new TSK 0
I20260807 06:45:39.185840 1079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:45:40.115387 1056 catalog_manager.cc:1259] Loaded cluster ID: 55806f31a59f4ca4a085b6bd81de2fa8
I20260807 06:45:40.115485 1056 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: loading cluster ID for follower catalog manager: success
I20260807 06:45:40.116421 1056 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: acquiring CA information for follower catalog manager: success
I20260807 06:45:40.116796 1056 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 85405c16cf794b5bbe48e9c9774ef274: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:45:40.170051 1111 catalog_manager.cc:1259] Loaded cluster ID: 55806f31a59f4ca4a085b6bd81de2fa8
I20260807 06:45:40.170131 1111 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: loading cluster ID for follower catalog manager: success
I20260807 06:45:40.171103 1111 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: acquiring CA information for follower catalog manager: success
I20260807 06:45:40.171512 1111 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c08683c1c0bb4f32a196bf07b733e089: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:45:40.237848 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 656
I20260807 06:45:40.248466 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 781
I20260807 06:45:40.260782 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 897
2026-08-07T06:45:40Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3033 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:45:40 dist-test-slave-8hhm krb5kdc[1126](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:45:40 dist-test-slave-8hhm krb5kdc[1126](info): set up 2 sockets
Aug 07 06:45:40 dist-test-slave-8hhm krb5kdc[1126](info): commencing operation
krb5kdc: starting...
W20260807 06:45:41.516459 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:45:41 dist-test-slave-8hhm krb5kdc[1126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:45:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:45:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:45:41.640350 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:38001
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:44325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:38001
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:41.722404 1140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:41.722651 1140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:41.722692 1140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:41.723821 1140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:41.723912 1140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:41.723935 1140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:41.723956 1140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:41.723987 1140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:41.725504 1140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:44325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:38001
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:38001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:41.725811 1140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:41.726042 1140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:41.730831 1146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:41.730856 1152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:41.730888 1140 server_base.cc:1034] running on GCE node
W20260807 06:45:41.730863 1149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:41.731256 1140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:41.731540 1140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:41.732739 1140 hybrid_clock.cc:648] HybridClock initialized: now 1786085141732701 us; error 50 us; skew 500 ppm
Aug 07 06:45:41 dist-test-slave-8hhm krb5kdc[1126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085141, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:41.735272 1140 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:41.735752 1140 webserver.cc:460] Webserver started at http://127.11.137.190:37155/ using document root <none> and password file <none>
I20260807 06:45:41.735989 1140 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:41.736083 1140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:41.736236 1140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:41.737339 1140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "68f7ea4aae584fceb53bfd595feaff3e"
format_stamp: "Formatted at 2026-08-07 06:45:41 on dist-test-slave-8hhm"
server_key: "49a0e9d005a39d51560f315b52c2770f"
server_key_iv: "9547a99e343d0e99fd93d50b2f884613"
server_key_version: "encryptionkey@0"
I20260807 06:45:41.737715 1140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "68f7ea4aae584fceb53bfd595feaff3e"
format_stamp: "Formatted at 2026-08-07 06:45:41 on dist-test-slave-8hhm"
server_key: "49a0e9d005a39d51560f315b52c2770f"
server_key_iv: "9547a99e343d0e99fd93d50b2f884613"
server_key_version: "encryptionkey@0"
I20260807 06:45:41.739049 1140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:45:41.739733 1163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:41.739907 1140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:41.740033 1140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "68f7ea4aae584fceb53bfd595feaff3e"
format_stamp: "Formatted at 2026-08-07 06:45:41 on dist-test-slave-8hhm"
server_key: "49a0e9d005a39d51560f315b52c2770f"
server_key_iv: "9547a99e343d0e99fd93d50b2f884613"
server_key_version: "encryptionkey@0"
I20260807 06:45:41.740111 1140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:41.768658 1140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:41.771178 1140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:41.771370 1140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:41.775692 1140 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:38001
I20260807 06:45:41.775750 1246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:38001 every 8 connection(s)
I20260807 06:45:41.776136 1140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:41.776997 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:41.779282 1248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e: Bootstrap starting.
I20260807 06:45:41.779898 1248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:41.780149 1248 log.cc:824] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:41.780803 1248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e: No bootstrap required, opened a new log
I20260807 06:45:41.782335 1248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f7ea4aae584fceb53bfd595feaff3e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38001 } }
I20260807 06:45:41.782488 1248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:41.782511 1248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f7ea4aae584fceb53bfd595feaff3e, State: Initialized, Role: FOLLOWER
I20260807 06:45:41.782651 1248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f7ea4aae584fceb53bfd595feaff3e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38001 } }
I20260807 06:45:41.782738 1248 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:45:41.782761 1248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:45:41.782790 1248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:41.783285 1248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f7ea4aae584fceb53bfd595feaff3e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38001 } }
I20260807 06:45:41.783380 1248 leader_election.cc:302] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68f7ea4aae584fceb53bfd595feaff3e; no voters:
I20260807 06:45:41.783499 1248 leader_election.cc:288] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:45:41.783587 1251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:41.783751 1251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [term 1 LEADER]: Becoming Leader. State: Replica: 68f7ea4aae584fceb53bfd595feaff3e, State: Running, Role: LEADER
I20260807 06:45:41.783761 1248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:41.783852 1251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f7ea4aae584fceb53bfd595feaff3e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38001 } }
I20260807 06:45:41.784260 1254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68f7ea4aae584fceb53bfd595feaff3e. Latest consensus state: current_term: 1 leader_uuid: "68f7ea4aae584fceb53bfd595feaff3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f7ea4aae584fceb53bfd595feaff3e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38001 } } }
I20260807 06:45:41.784353 1254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:41.784479 1253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68f7ea4aae584fceb53bfd595feaff3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f7ea4aae584fceb53bfd595feaff3e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 38001 } } }
I20260807 06:45:41.784613 1253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:41.784776 1260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:41.785333 1260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:41.785733 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 1140
I20260807 06:45:41.785826 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:45:41.786078 11814 external_mini_cluster.cc:1428] Setting key 638ac3fa2f89b77b7c251b7178e85d25
I20260807 06:45:41.789908 1260 catalog_manager.cc:1347] Generated new cluster ID: 023bfd53775c4d29b73c9c448a977be9
I20260807 06:45:41.789968 1260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:45:41 dist-test-slave-8hhm krb5kdc[1126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:41.798494 1281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:41.786498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41270 (local address 127.11.137.190:38001)
0807 06:45:41.786663 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:41.786672 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:41.789453 (+ 2781us) server_negotiation.cc:407] Connection header received
0807 06:45:41.789617 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:41.789624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:41.789692 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:41.789826 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:41.790585 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:41.791461 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:41.792234 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:41.792654 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:41.792781 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:41.795129 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:41.795133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:41.795133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:41.795144 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:41.796870 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:41.797345 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:41.797348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:41.797349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:41.797457 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:41.797676 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:41.797677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:41.797677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:41.797905 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:41.798070 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:41.798175 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 06:45:41.798312 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":88,"threads_started":1}
I20260807 06:45:41.799394 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:45:41.804116 1260 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:45:41.804623 1260 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:45:41.808740 1260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68f7ea4aae584fceb53bfd595feaff3e: Generated new TSK 0
I20260807 06:45:41.808913 1260 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:45:41.853621 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 1140
2026-08-07T06:45:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1594 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:45:41 dist-test-slave-8hhm krb5kdc[1289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:45:41 dist-test-slave-8hhm krb5kdc[1289](info): set up 2 sockets
Aug 07 06:45:41 dist-test-slave-8hhm krb5kdc[1289](info): commencing operation
krb5kdc: starting...
W20260807 06:45:43.104535 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:45:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:45:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:45:43.226389 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46581
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:46581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:43.308126 1310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:43.308373 1310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:43.308411 1310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:43.309718 1310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:43.309787 1310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:43.309810 1310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:43.309831 1310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:43.309861 1310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:43.311348 1310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:46581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:43.311628 1310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:43.311882 1310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:43.316758 1323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.316783 1317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.316759 1319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:43.316892 1310 server_base.cc:1034] running on GCE node
I20260807 06:45:43.317253 1310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:43.317530 1310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:43.318675 1310 hybrid_clock.cc:648] HybridClock initialized: now 1786085143318661 us; error 29 us; skew 500 ppm
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:43.326956 1310 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:43.327451 1310 webserver.cc:460] Webserver started at http://127.11.137.190:38283/ using document root <none> and password file <none>
I20260807 06:45:43.327687 1310 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:43.327734 1310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:43.327916 1310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:43.328992 1310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3f6b02a2cbf53778eca14fcfe2fc2379"
server_key_iv: "f9c3fcc4a83cdd9de029171280734831"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.329430 1310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3f6b02a2cbf53778eca14fcfe2fc2379"
server_key_iv: "f9c3fcc4a83cdd9de029171280734831"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.330755 1310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:43.331518 1331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.331732 1310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:43.331840 1310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3f6b02a2cbf53778eca14fcfe2fc2379"
server_key_iv: "f9c3fcc4a83cdd9de029171280734831"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.331910 1310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:43.346016 1310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:43.347854 1310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:43.348021 1310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:43.352421 1310 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:46581
I20260807 06:45:43.352474 1408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:46581 every 8 connection(s)
I20260807 06:45:43.352835 1310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:43.353876 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:43.356236 1410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap starting.
I20260807 06:45:43.356839 1410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:43.357147 1410 log.cc:824] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:43.357854 1410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: No bootstrap required, opened a new log
I20260807 06:45:43.359462 1410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:43.359629 1410 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:43.359654 1410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76e0fb31ae8b4287bb7d5a3d28b72d2b, State: Initialized, Role: FOLLOWER
I20260807 06:45:43.359808 1410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:43.359875 1410 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:45:43.359896 1410 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:45:43.359959 1410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:43.360798 1410 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:43.360917 1410 leader_election.cc:302] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76e0fb31ae8b4287bb7d5a3d28b72d2b; no voters:
I20260807 06:45:43.361100 1410 leader_election.cc:288] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:45:43.361142 1417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:43.361385 1410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:43.361367 1417 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 LEADER]: Becoming Leader. State: Replica: 76e0fb31ae8b4287bb7d5a3d28b72d2b, State: Running, Role: LEADER
I20260807 06:45:43.361531 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 1310
I20260807 06:45:43.361627 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:45:43.361610 1417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:43.361864 11814 external_mini_cluster.cc:1428] Setting key 15412888e1df1d52c68b65e5c8d60953
I20260807 06:45:43.361989 1418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } } }
I20260807 06:45:43.362061 1418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:43.362020 1419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76e0fb31ae8b4287bb7d5a3d28b72d2b. Latest consensus state: current_term: 1 leader_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } } }
I20260807 06:45:43.362124 1419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:43.362346 1427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:43.362969 1427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:43.368034 1427 catalog_manager.cc:1347] Generated new cluster ID: 59c57e95516341c4846a28d5a575660e
I20260807 06:45:43.368095 1427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:43.373602 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.362525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50218 (local address 127.11.137.190:46581)
0807 06:45:43.363763 (+ 1238us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.363771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.363797 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:45:43.363886 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.363892 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.363933 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.364087 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:43.364737 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.365733 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.366499 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.366926 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.367041 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.369910 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:43.369914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:43.369914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:43.369926 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:43.371889 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.372317 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.372319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.372320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.372433 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.372658 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.372658 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.372659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.372963 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:43.373131 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.373264 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.373395 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1200,"thread_start_us":81,"threads_started":1}
I20260807 06:45:43.374789 1427 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:45:43.375442 1427 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:45:43.384774 1427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Generated new TSK 0
I20260807 06:45:43.384950 1427 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:45:43.416742 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46581
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:43.502308 1455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:43.502501 1455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:43.502524 1455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:43.503563 1455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:43.503597 1455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:43.503623 1455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:45:43.504998 1455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:43.505180 1455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:43.505416 1455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:45:43.510372 1455 server_base.cc:1034] running on GCE node
W20260807 06:45:43.510313 1461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.510337 1462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.510331 1464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:43.510881 1455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:43.511179 1455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:43.512334 1455 hybrid_clock.cc:648] HybridClock initialized: now 1786085143512318 us; error 26 us; skew 500 ppm
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:43.514967 1455 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:45:43.515426 1455 webserver.cc:460] Webserver started at http://127.11.137.129:37341/ using document root <none> and password file <none>
I20260807 06:45:43.515656 1455 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:43.515708 1455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:43.515877 1455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:43.516893 1455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "bad5a920312a401594de9642b6fb0576"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3d951f56877ad2bf3ae833abb85413c3"
server_key_iv: "8d31ead30018840fd5e9b6b974ae5e2e"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.517319 1455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "bad5a920312a401594de9642b6fb0576"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3d951f56877ad2bf3ae833abb85413c3"
server_key_iv: "8d31ead30018840fd5e9b6b974ae5e2e"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.518769 1455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:43.519554 1474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.519744 1455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:45:43.519848 1455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "bad5a920312a401594de9642b6fb0576"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3d951f56877ad2bf3ae833abb85413c3"
server_key_iv: "8d31ead30018840fd5e9b6b974ae5e2e"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.519938 1455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:43.532323 1455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:43.534312 1455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:43.534471 1455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:43.534737 1455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:43.535049 1455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:43.535104 1455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.535143 1455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:43.535171 1455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.541182 1455 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:42331
I20260807 06:45:43.541271 1658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:42331 every 8 connection(s)
I20260807 06:45:43.541559 1455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:45:43.542171 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 1455
I20260807 06:45:43.542296 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:45:43.542589 11814 external_mini_cluster.cc:1428] Setting key 17bf357cad50f89510c21981927e39e9
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:43.552382 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.542336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:45435 (local address 127.11.137.190:46581)
0807 06:45:43.542380 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.542382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.542618 (+ 236us) server_negotiation.cc:407] Connection header received
0807 06:45:43.543250 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.543252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.543264 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.543327 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:43.544258 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.544753 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.545828 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.546060 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.546138 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.548708 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:43.548710 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:43.548710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:43.548719 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:43.550757 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.551239 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.551241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.551241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.551337 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.551627 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.551629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.551629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.551804 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:43.551894 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.552164 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.552275 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:45:43.552403 1662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.542327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:45435)
0807 06:45:43.542493 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:43.542527 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:43.543145 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:43.543403 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:43.543406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:43.543952 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:43.544156 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.544161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.544852 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.544853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.545732 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.545735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.546147 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.546147 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.546285 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.546824 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:43.546832 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:43.548611 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:43.550868 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:43.550875 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:43.550877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:43.551151 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:43.551436 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:43.551437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:43.551437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:43.551552 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:43.551884 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:43.551889 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:43.552023 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 06:45:43.552106 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:45:43.552238 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":105,"threads_started":1}
I20260807 06:45:43.553167 1659 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46581
I20260807 06:45:43.553310 1659 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:43.553525 1659 heartbeater.cc:511] Master 127.11.137.190:46581 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:45:43.554198 1354 ts_manager.cc:194] Registered new tserver with Master: bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331)
I20260807 06:45:43.554850 1354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:45435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:45:43.571841 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46581
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:43.654870 1665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:43.655057 1665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:43.655079 1665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:43.656097 1665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:43.656131 1665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:43.656159 1665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:45:43.657663 1665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:43.657842 1665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:43.658004 1665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:43.663097 1670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.663106 1672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.663106 1677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:43.663479 1665 server_base.cc:1034] running on GCE node
I20260807 06:45:43.663703 1665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:43.663978 1665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:43.665156 1665 hybrid_clock.cc:648] HybridClock initialized: now 1786085143665144 us; error 30 us; skew 500 ppm
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:43.667740 1665 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:45:43.668227 1665 webserver.cc:460] Webserver started at http://127.11.137.130:44057/ using document root <none> and password file <none>
I20260807 06:45:43.668476 1665 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:43.668546 1665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:43.668696 1665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:43.669790 1665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "e0b209422ecb4e68a61e21a84458d6fc"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "209dbf931fc1d5383707989be932e5c4"
server_key_iv: "df6cf94964379e51c3e0137bbc2e8188"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.670159 1665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "e0b209422ecb4e68a61e21a84458d6fc"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "209dbf931fc1d5383707989be932e5c4"
server_key_iv: "df6cf94964379e51c3e0137bbc2e8188"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.671474 1665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:45:43.672185 1690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.672356 1665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:45:43.672448 1665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "e0b209422ecb4e68a61e21a84458d6fc"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "209dbf931fc1d5383707989be932e5c4"
server_key_iv: "df6cf94964379e51c3e0137bbc2e8188"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.672533 1665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:43.686800 1665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:43.688603 1665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:43.688763 1665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:43.689003 1665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:43.689370 1665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:43.689407 1665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.689429 1665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:43.689474 1665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.695530 1665 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:38179
I20260807 06:45:43.695573 1879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:38179 every 8 connection(s)
I20260807 06:45:43.695895 1665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:45:43.697098 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 1665
I20260807 06:45:43.697193 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:45:43.697443 11814 external_mini_cluster.cc:1428] Setting key 0ab795b935ebff121d2db2b1c318cfee
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:43.706511 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.696583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:35373 (local address 127.11.137.190:46581)
0807 06:45:43.696657 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.696659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.696895 (+ 236us) server_negotiation.cc:407] Connection header received
0807 06:45:43.697625 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.697627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.697642 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.697692 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:43.698730 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.699217 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.700588 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.700790 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.700844 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.703544 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:43.703545 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:43.703546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:43.703554 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:43.704973 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.705478 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.705479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.705480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.705544 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.705824 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.705825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.705825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.705939 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:43.706014 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.706324 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.706417 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 06:45:43.706667 1885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.696556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:35373)
0807 06:45:43.696740 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:43.696776 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:43.697454 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:43.697776 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:43.697779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:43.698437 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:43.698624 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.698628 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.699319 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.699320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.700467 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.700470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.700877 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.700878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.701027 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.701608 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:43.701616 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:43.703442 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:43.705064 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:43.705071 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:43.705074 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:43.705387 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:43.705615 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:43.705616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:43.705616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:43.705736 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:43.706016 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:43.706023 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:43.706163 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 06:45:43.706287 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 06:45:43.706442 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":106,"threads_started":1}
I20260807 06:45:43.707137 1881 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46581
I20260807 06:45:43.707247 1881 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:43.707434 1881 heartbeater.cc:511] Master 127.11.137.190:46581 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
I20260807 06:45:43.707849 1354 ts_manager.cc:194] Registered new tserver with Master: e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
I20260807 06:45:43.708223 1354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:35373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:45:43.726040 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46581
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:43.808499 1888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:43.808701 1888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:43.808725 1888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:43.809880 1888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:43.809921 1888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:43.809947 1888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:45:43.811535 1888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:43.811807 1888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:43.812045 1888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:43.816994 1895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.816995 1897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:43.816987 1899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:43.817324 1888 server_base.cc:1034] running on GCE node
I20260807 06:45:43.817521 1888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:43.817761 1888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:43.818943 1888 hybrid_clock.cc:648] HybridClock initialized: now 1786085143818933 us; error 32 us; skew 500 ppm
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:43.821614 1888 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:45:43.822090 1888 webserver.cc:460] Webserver started at http://127.11.137.131:38789/ using document root <none> and password file <none>
I20260807 06:45:43.822296 1888 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:43.822336 1888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:43.822424 1888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:45:43.823441 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "0e0f9131012a4a078391e5e1d34dfa5f"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "c68a71512585c6db4bf4b56e9f736621"
server_key_iv: "4fffe6f62604721f759e049c5a8f8cc1"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.823737 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "0e0f9131012a4a078391e5e1d34dfa5f"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "c68a71512585c6db4bf4b56e9f736621"
server_key_iv: "4fffe6f62604721f759e049c5a8f8cc1"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.824965 1888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:45:43.825810 1910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.826023 1888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:45:43.826130 1888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "0e0f9131012a4a078391e5e1d34dfa5f"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "c68a71512585c6db4bf4b56e9f736621"
server_key_iv: "4fffe6f62604721f759e049c5a8f8cc1"
server_key_version: "encryptionkey@0"
I20260807 06:45:43.826188 1888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:43.840847 1888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:43.843156 1888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:43.843267 1888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:43.843441 1888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:43.843753 1888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:43.843789 1888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.843813 1888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:43.843860 1888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:43.849943 1888 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:40123
I20260807 06:45:43.849997 2093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:40123 every 8 connection(s)
I20260807 06:45:43.850308 1888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:45:43.851583 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 1888
I20260807 06:45:43.851697 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:45:43.851907 11814 external_mini_cluster.cc:1428] Setting key eca05b7b0fafecf161de9f44b5594c0b
Aug 07 06:45:43 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085143, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:43.859733 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.851001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:51559 (local address 127.11.137.190:46581)
0807 06:45:43.851069 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.851071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.851268 (+ 197us) server_negotiation.cc:407] Connection header received
0807 06:45:43.852088 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.852090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.852122 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.852199 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:43.853518 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.854001 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.854939 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.855123 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.855172 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.857373 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:43.857374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:43.857375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:43.857381 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:43.858542 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.858906 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.858907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.858907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.858960 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.859193 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.859193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.859194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.859290 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:43.859377 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.859597 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.859660 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:45:43.859866 2097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.850962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:51559)
0807 06:45:43.851139 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:43.851190 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:43.851923 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:43.852379 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:43.852385 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:43.853178 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:43.853439 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.853445 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.854080 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.854080 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.854866 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.854868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.855203 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.855204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.855307 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.855845 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:43.855853 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:43.857289 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:43.858614 (+ 1325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:43.858620 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:43.858622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:43.858836 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:43.859020 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:43.859021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:43.859021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:43.859133 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:43.859367 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:43.859371 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:43.859479 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 06:45:43.859560 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:45:43.859678 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
I20260807 06:45:43.860383 2094 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46581
I20260807 06:45:43.860491 2094 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:43.860663 2094 heartbeater.cc:511] Master 127.11.137.190:46581 requested a full tablet report, sending...
I20260807 06:45:43.861019 1354 ts_manager.cc:194] Registered new tserver with Master: 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123)
I20260807 06:45:43.861465 1354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:51559
I20260807 06:45:43.863683 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:45:43.870878 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.865061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.11.137.190:46581)
0807 06:45:43.865123 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.865124 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.865303 (+ 179us) server_negotiation.cc:407] Connection header received
0807 06:45:43.865378 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.865379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.865389 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.865460 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:43.866019 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.866472 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.867217 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.867400 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.867476 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.868546 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:43.868547 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:43.868548 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:43.868555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:43.869717 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.870065 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.870066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.870067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.870123 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:43.870332 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:43.870333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:43.870333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:43.870466 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:43.870571 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.870709 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.870780 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:45:43.872294 1354 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:45:43.873914 1354 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:45:43.880311 2114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.876244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42331 (local address 127.0.0.1:39124)
0807 06:45:43.876563 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:43.876573 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:43.876631 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:43.876902 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:43.876903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:43.876905 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:43.876963 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.876965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.877894 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.877896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.879091 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.879094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.879987 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.879989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.880076 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.880094 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 06:45:43.880160 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:45:43.880218 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":63,"threads_started":1}
I20260807 06:45:43.880586 2118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.876430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50420 (local address 127.11.137.130:38179)
0807 06:45:43.876610 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.876614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.876626 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:45:43.876667 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.876670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.876700 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.876974 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:43.877053 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.878173 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.879429 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.880009 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.880131 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.880194 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.880327 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.880375 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260807 06:45:43.880599 2117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.876386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39124 (local address 127.11.137.129:42331)
0807 06:45:43.876584 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.876589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.876620 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:45:43.876716 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.876718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.876735 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.876814 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:43.877033 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.877790 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.879191 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.879896 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.879977 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.880029 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.880466 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.880511 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
I20260807 06:45:43.880752 2115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.876238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.11.137.131:40123)
0807 06:45:43.876775 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:43.876780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:43.876788 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:45:43.876822 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:43.876824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:43.876838 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:43.877067 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:43.877129 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.878215 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.879446 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.880172 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.880542 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.880586 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:43.880608 (+ 22us) server_negotiation.cc:299] Negotiation successful
0807 06:45:43.880666 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":89,"threads_started":1}
I20260807 06:45:43.880417 2105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.876045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38179 (local address 127.0.0.1:50420)
0807 06:45:43.876163 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:43.876204 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:43.876275 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:43.876816 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:43.876819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:43.876822 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:43.876893 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.876895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.878288 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.878289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.879334 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.879336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.880158 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.880159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.880237 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.880242 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:45:43.880298 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 06:45:43.880340 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":27,"thread_start_us":64,"threads_started":1}
I20260807 06:45:43.880493 2113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:43.876048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40123 (local address 127.0.0.1:59374)
0807 06:45:43.876376 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:43.876386 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:43.876436 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:43.876938 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:43.876939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:43.876941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:43.876995 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.876997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.878337 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.878338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.879347 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:43.879350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:43.880268 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:43.880269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:43.880334 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:43.880337 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:45:43.880367 (+ 30us) client_negotiation.cc:240] Negotiation successful
0807 06:45:43.880397 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":60,"threads_started":1}
I20260807 06:45:43.881543 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 89f5878ad7324604b2139f33d81a1368 (DEFAULT_TABLE table=test-table [id=638435f7ee8a40249445d352ff98676c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:43.881928 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f5878ad7324604b2139f33d81a1368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:43.881898 1989 tablet_service.cc:1467] Processing CreateTablet for tablet 89f5878ad7324604b2139f33d81a1368 (DEFAULT_TABLE table=test-table [id=638435f7ee8a40249445d352ff98676c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:43.881940 1772 tablet_service.cc:1467] Processing CreateTablet for tablet 89f5878ad7324604b2139f33d81a1368 (DEFAULT_TABLE table=test-table [id=638435f7ee8a40249445d352ff98676c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:43.882234 1989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f5878ad7324604b2139f33d81a1368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:43.882268 1772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f5878ad7324604b2139f33d81a1368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:43.884574 2119 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Bootstrap starting.
I20260807 06:45:43.885176 2119 tablet_bootstrap.cc:654] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:43.885450 2122 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Bootstrap starting.
I20260807 06:45:43.885632 2120 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Bootstrap starting.
I20260807 06:45:43.886078 2119 log.cc:824] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:43.886209 2122 tablet_bootstrap.cc:654] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:43.886300 2120 tablet_bootstrap.cc:654] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:43.886833 2119 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: No bootstrap required, opened a new log
I20260807 06:45:43.886921 2119 ts_tablet_manager.cc:1397] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:45:43.886922 2122 log.cc:824] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:43.886960 2120 log.cc:824] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:43.887763 2120 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: No bootstrap required, opened a new log
I20260807 06:45:43.887795 2122 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: No bootstrap required, opened a new log
I20260807 06:45:43.887851 2120 ts_tablet_manager.cc:1397] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:45:43.887856 2122 ts_tablet_manager.cc:1397] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:45:43.888609 2119 raft_consensus.cc:348] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:43.888777 2119 raft_consensus.cc:374] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:43.888844 2119 raft_consensus.cc:729] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0f9131012a4a078391e5e1d34dfa5f, State: Initialized, Role: FOLLOWER
I20260807 06:45:43.888970 2119 consensus_queue.cc:260] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:43.889299 2094 heartbeater.cc:503] Master 127.11.137.190:46581 was elected leader, sending a full tablet report...
I20260807 06:45:43.889295 2119 ts_tablet_manager.cc:1428] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:45:43.889851 2120 raft_consensus.cc:348] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:43.889870 2122 raft_consensus.cc:348] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:43.890013 2122 raft_consensus.cc:374] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:43.890059 2120 raft_consensus.cc:374] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:43.890059 2122 raft_consensus.cc:729] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b209422ecb4e68a61e21a84458d6fc, State: Initialized, Role: FOLLOWER
I20260807 06:45:43.890103 2120 raft_consensus.cc:729] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad5a920312a401594de9642b6fb0576, State: Initialized, Role: FOLLOWER
I20260807 06:45:43.890196 2122 consensus_queue.cc:260] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:43.890202 2120 consensus_queue.cc:260] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:43.890465 2122 ts_tablet_manager.cc:1428] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 06:45:43.890465 2120 ts_tablet_manager.cc:1428] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:45:43.890550 1881 heartbeater.cc:503] Master 127.11.137.190:46581 was elected leader, sending a full tablet report...
I20260807 06:45:43.890820 1659 heartbeater.cc:503] Master 127.11.137.190:46581 was elected leader, sending a full tablet report...
W20260807 06:45:43.946498 1882 tablet.cc:2369] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:45:44.004113 2132 raft_consensus.cc:482] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:44.004254 2132 raft_consensus.cc:504] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.004637 2132 leader_election.cc:288] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179), 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123)
I20260807 06:45:44.008673 2118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.004922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:48353 (local address 127.11.137.130:38179)
0807 06:45:44.004972 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.004974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.004987 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:45:44.005020 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.005021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.005033 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.005101 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.005368 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.006136 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.007700 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.008290 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.008370 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.008378 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.008555 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.008607 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:45:44.008672 2115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.004943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:46335 (local address 127.11.137.131:40123)
0807 06:45:44.005000 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.005002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.005169 (+ 167us) server_negotiation.cc:407] Connection header received
0807 06:45:44.005206 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.005207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.005232 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.005276 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.005458 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.006150 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.007700 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.008290 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.008370 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.008378 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.008555 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.008596 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:45:44.008680 2133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.004850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40123 (local address 127.11.137.129:46335)
0807 06:45:44.005065 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.005073 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.005144 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.005305 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.005306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.005307 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.005380 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.005383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.006231 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.006231 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.007593 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.007596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.008383 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.008384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.008463 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.008467 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.008526 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.008582 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":82,"thread_start_us":126,"threads_started":1}
I20260807 06:45:44.008687 1662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.004835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38179 (local address 127.11.137.129:48353)
0807 06:45:44.004897 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.004909 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.004951 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.005131 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.005132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.005134 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.005254 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.005256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.006230 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.006231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.007592 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.007596 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.008383 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.008384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.008465 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.008467 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.008526 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.008583 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":107}
I20260807 06:45:44.009085 2021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f5878ad7324604b2139f33d81a1368" candidate_uuid: "bad5a920312a401594de9642b6fb0576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" is_pre_election: true
I20260807 06:45:44.009106 1807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f5878ad7324604b2139f33d81a1368" candidate_uuid: "bad5a920312a401594de9642b6fb0576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b209422ecb4e68a61e21a84458d6fc" is_pre_election: true
I20260807 06:45:44.009289 2021 raft_consensus.cc:2454] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad5a920312a401594de9642b6fb0576 in term 0.
I20260807 06:45:44.009289 1807 raft_consensus.cc:2454] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad5a920312a401594de9642b6fb0576 in term 0.
I20260807 06:45:44.009584 1477 leader_election.cc:302] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad5a920312a401594de9642b6fb0576, e0b209422ecb4e68a61e21a84458d6fc; no voters:
I20260807 06:45:44.009732 2132 raft_consensus.cc:2781] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:45:44.009792 2132 raft_consensus.cc:482] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:45:44.009816 2132 raft_consensus.cc:3037] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:44.010564 2132 raft_consensus.cc:504] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.010721 2132 leader_election.cc:288] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 1 election: Requested vote from peers e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179), 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123)
I20260807 06:45:44.010886 1807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f5878ad7324604b2139f33d81a1368" candidate_uuid: "bad5a920312a401594de9642b6fb0576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b209422ecb4e68a61e21a84458d6fc"
I20260807 06:45:44.010921 2021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f5878ad7324604b2139f33d81a1368" candidate_uuid: "bad5a920312a401594de9642b6fb0576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0f9131012a4a078391e5e1d34dfa5f"
I20260807 06:45:44.010984 2021 raft_consensus.cc:3037] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:44.010974 1807 raft_consensus.cc:3037] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:44.011900 1807 raft_consensus.cc:2454] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad5a920312a401594de9642b6fb0576 in term 1.
I20260807 06:45:44.011900 2021 raft_consensus.cc:2454] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad5a920312a401594de9642b6fb0576 in term 1.
I20260807 06:45:44.012081 1477 leader_election.cc:302] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad5a920312a401594de9642b6fb0576, e0b209422ecb4e68a61e21a84458d6fc; no voters:
I20260807 06:45:44.012254 2132 raft_consensus.cc:2781] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:44.012396 2132 raft_consensus.cc:686] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 LEADER]: Becoming Leader. State: Replica: bad5a920312a401594de9642b6fb0576, State: Running, Role: LEADER
I20260807 06:45:44.012502 2132 consensus_queue.cc:237] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.013438 1354 catalog_manager.cc:5495] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 reported cstate change: term changed from 0 to 1, leader changed from <none> to bad5a920312a401594de9642b6fb0576 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "bad5a920312a401594de9642b6fb0576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } health_report { overall_health: HEALTHY } } }
I20260807 06:45:44.027297 2117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.025237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.11.137.129:42331)
0807 06:45:44.025286 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.025288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.025322 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:45:44.025349 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.025350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.025367 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.025418 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:45:44.025531 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.025993 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.026673 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.026848 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.026897 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.027028 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:45:44.027126 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:45:44.027188 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.027227 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.027244 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:45:44.029081 2021 raft_consensus.cc:1261] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Refusing update from remote peer bad5a920312a401594de9642b6fb0576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:44.029081 1807 raft_consensus.cc:1261] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Refusing update from remote peer bad5a920312a401594de9642b6fb0576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:44.029496 2135 consensus_queue.cc:1035] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:44.029646 2132 consensus_queue.cc:1035] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:44.032018 2138 mvcc.cc:205] Tried to move back new op lower bound from 7315804749940273152 to 7315804749875867648. Current Snapshot: MvccSnapshot[applied={T|T < 7315804749940273152}]
I20260807 06:45:44.032325 2139 mvcc.cc:205] Tried to move back new op lower bound from 7315804749940273152 to 7315804749875867648. Current Snapshot: MvccSnapshot[applied={T|T < 7315804749940273152}]
I20260807 06:45:44.034801 1353 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:45:44.034906 1353 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:45:44.035742 1353 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Sending DeleteTablet for 3 replicas of tablet 89f5878ad7324604b2139f33d81a1368
I20260807 06:45:44.036051 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 1455
I20260807 06:45:44.036150 1549 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5878ad7324604b2139f33d81a1368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:39124
I20260807 06:45:44.036190 1772 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5878ad7324604b2139f33d81a1368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:50420
I20260807 06:45:44.036586 1989 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5878ad7324604b2139f33d81a1368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:59374
I20260807 06:45:44.036818 2153 tablet_replica.cc:330] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: stopping tablet replica
I20260807 06:45:44.036911 2153 raft_consensus.cc:2229] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:45:44.036996 2153 raft_consensus.cc:2258] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:44.039155 2153 ts_tablet_manager.cc:1905] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:44.039213 2151 tablet_replica.cc:330] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: stopping tablet replica
I20260807 06:45:44.039299 2151 raft_consensus.cc:2229] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:45:44.039388 2151 raft_consensus.cc:2258] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:44.040946 2153 ts_tablet_manager.cc:1918] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:44.041013 2153 log.cc:1196] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/89f5878ad7324604b2139f33d81a1368
I20260807 06:45:44.041106 2151 ts_tablet_manager.cc:1905] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:44.041326 2153 ts_tablet_manager.cc:1939] T 89f5878ad7324604b2139f33d81a1368 P 0e0f9131012a4a078391e5e1d34dfa5f: Deleting consensus metadata
I20260807 06:45:44.042889 2151 ts_tablet_manager.cc:1918] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:44.043025 2151 log.cc:1196] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/89f5878ad7324604b2139f33d81a1368
I20260807 06:45:44.043363 2151 ts_tablet_manager.cc:1939] T 89f5878ad7324604b2139f33d81a1368 P e0b209422ecb4e68a61e21a84458d6fc: Deleting consensus metadata
I20260807 06:45:44.043773 1333 catalog_manager.cc:4841] TS e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): tablet 89f5878ad7324604b2139f33d81a1368 (table test-table [id=638435f7ee8a40249445d352ff98676c]) successfully deleted
I20260807 06:45:44.043924 1335 catalog_manager.cc:4841] TS 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): tablet 89f5878ad7324604b2139f33d81a1368 (table test-table [id=638435f7ee8a40249445d352ff98676c]) successfully deleted
W20260807 06:45:44.049876 1333 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:42331 (error 108)
I20260807 06:45:44.050166 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 1665
I20260807 06:45:44.050402 2105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.050255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42331 (local address 127.0.0.1:39136)
0807 06:45:44.050326 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.050363 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 06:45:44.053534 1333 catalog_manager.cc:4584] TS bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 89f5878ad7324604b2139f33d81a1368: Network error: Client connection negotiation failed: client connection to 127.11.137.129:42331: connect: Connection refused (error 111)
I20260807 06:45:44.061365 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 1888
I20260807 06:45:44.075939 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 1310
I20260807 06:45:44.086771 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46581
--webserver_interface=127.11.137.190
--webserver_port=38283
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:46581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:44.169669 2155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:44.169885 2155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:44.169906 2155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:44.171052 2155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:44.171095 2155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:44.171109 2155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:44.171121 2155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:44.171133 2155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:44.172662 2155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:46581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=38283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:44.172923 2155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:44.173161 2155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:44.184052 2172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.184080 2169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.184052 2174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.184494 2155 server_base.cc:1034] running on GCE node
I20260807 06:45:44.184783 2155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:44.185094 2155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:44.186259 2155 hybrid_clock.cc:648] HybridClock initialized: now 1786085144186249 us; error 42 us; skew 500 ppm
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:44.188776 2155 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:44.189298 2155 webserver.cc:460] Webserver started at http://127.11.137.190:38283/ using document root <none> and password file <none>
I20260807 06:45:44.189543 2155 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:44.189627 2155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:44.190994 2155 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:44.191663 2184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.191867 2155 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:45:44.191982 2155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3f6b02a2cbf53778eca14fcfe2fc2379"
server_key_iv: "f9c3fcc4a83cdd9de029171280734831"
server_key_version: "encryptionkey@0"
I20260807 06:45:44.192401 2155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:44.219480 2155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:44.221436 2155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:44.221604 2155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:44.225878 2155 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:46581
I20260807 06:45:44.225936 2271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:46581 every 8 connection(s)
I20260807 06:45:44.226368 2155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:44.228093 2272 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:45:44.228797 2272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap starting.
I20260807 06:45:44.232239 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 2155
I20260807 06:45:44.232553 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:42331
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:46581
--webserver_port=37341
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:44.237963 2272 log.cc:824] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:44.239887 2272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:45:44.240228 2272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap complete.
I20260807 06:45:44.242612 2272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:44.242866 2272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76e0fb31ae8b4287bb7d5a3d28b72d2b, State: Initialized, Role: FOLLOWER
I20260807 06:45:44.243074 2272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:44.243178 2272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:45:44.243237 2272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:45:44.243284 2272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:45:44.244289 2272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:44.244412 2272 leader_election.cc:302] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76e0fb31ae8b4287bb7d5a3d28b72d2b; no voters:
I20260807 06:45:44.244611 2272 leader_election.cc:288] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:45:44.244683 2277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:45:44.244829 2277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 LEADER]: Becoming Leader. State: Replica: 76e0fb31ae8b4287bb7d5a3d28b72d2b, State: Running, Role: LEADER
I20260807 06:45:44.244890 2272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:44.245016 2277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:44.245373 2278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } } }
I20260807 06:45:44.245445 2278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:44.245792 2280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76e0fb31ae8b4287bb7d5a3d28b72d2b. Latest consensus state: current_term: 2 leader_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } } }
I20260807 06:45:44.245857 2280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:44.246007 2283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:44.246778 2283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:44.246878 2283 catalog_manager.cc:1259] Loaded cluster ID: 59c57e95516341c4846a28d5a575660e
I20260807 06:45:44.246978 2283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:45:44.247459 2283 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 06:45:44.250212 2283 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 06:45:44.252031 2283 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:45:44.252264 2283 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Loaded TSK: 0
I20260807 06:45:44.252478 2283 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:45:44.323844 2274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:44.324095 2274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:44.324139 2274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:44.325309 2274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:44.325379 2274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:44.325421 2274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:45:44.326957 2274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:42331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=37341
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:44.327265 2274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:44.327513 2274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:44.333684 2315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.333890 2274 server_base.cc:1034] running on GCE node
W20260807 06:45:44.333671 2314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.333925 2317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.334264 2274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:44.334522 2274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:44.335716 2274 hybrid_clock.cc:648] HybridClock initialized: now 1786085144335700 us; error 31 us; skew 500 ppm
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:44.338506 2274 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:45:44.338937 2274 webserver.cc:460] Webserver started at http://127.11.137.129:37341/ using document root <none> and password file <none>
I20260807 06:45:44.339180 2274 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:44.339267 2274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:44.340698 2274 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:44.341473 2324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.341665 2274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:44.341773 2274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "bad5a920312a401594de9642b6fb0576"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3d951f56877ad2bf3ae833abb85413c3"
server_key_iv: "8d31ead30018840fd5e9b6b974ae5e2e"
server_key_version: "encryptionkey@0"
I20260807 06:45:44.342132 2274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:44.352255 2274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:44.354564 2274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:44.354724 2274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:44.354943 2274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:44.355378 2338 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:45:44.357285 2274 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:45:44.357337 2274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 06:45:44.357370 2274 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:45:44.358223 2274 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:45:44.358273 2274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 06:45:44.358356 2338 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Bootstrap starting.
I20260807 06:45:44.365741 2274 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:42331
I20260807 06:45:44.366197 2274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:45:44.366649 2502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:42331 every 8 connection(s)
I20260807 06:45:44.368412 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 2274
I20260807 06:45:44.368712 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:38179
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:46581
--webserver_port=44057
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:44.369772 2338 log.cc:824] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:44.372892 2338 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:45:44.373245 2338 tablet_bootstrap.cc:492] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Bootstrap complete.
I20260807 06:45:44.374425 2338 ts_tablet_manager.cc:1397] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.009s
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:44.375753 2338 raft_consensus.cc:348] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.376050 2338 raft_consensus.cc:729] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad5a920312a401594de9642b6fb0576, State: Initialized, Role: FOLLOWER
I20260807 06:45:44.376245 2338 consensus_queue.cc:260] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.376566 2338 ts_tablet_manager.cc:1428] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260807 06:45:44.380414 2505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.366887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:39795)
0807 06:45:44.367409 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.367457 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.368067 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.368759 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.368764 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.369283 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:44.369566 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.369575 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.371186 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.371188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.372419 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.372422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.373278 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.373280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.373422 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.374044 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:44.374054 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:44.375856 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:44.378422 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:44.378431 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:44.378433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:44.378766 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:44.379091 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:44.379092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:44.379092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:44.379236 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:44.379737 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:44.379744 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:44.379897 (+ 153us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.380008 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.380202 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":120,"threads_started":1}
I20260807 06:45:44.380470 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.367191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:39795 (local address 127.11.137.190:46581)
0807 06:45:44.367424 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.367434 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.367582 (+ 148us) server_negotiation.cc:407] Connection header received
0807 06:45:44.368355 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.368363 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.368428 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.368580 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:44.369731 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.371076 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.372524 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.373138 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.373281 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.376003 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:44.376008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:44.376008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:44.376021 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:44.378316 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.378858 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.378861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.378861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.379005 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.379317 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.379318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.379319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.379654 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:44.379750 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.380099 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.380258 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":100,"threads_started":1}
I20260807 06:45:44.381749 2503 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46581
I20260807 06:45:44.381865 2503 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:44.382040 2503 heartbeater.cc:511] Master 127.11.137.190:46581 requested a full tablet report, sending...
I20260807 06:45:44.382887 2205 ts_manager.cc:194] Registered new tserver with Master: bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331)
I20260807 06:45:44.384249 2205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:39795
I20260807 06:45:44.385247 2503 heartbeater.cc:503] Master 127.11.137.190:46581 was elected leader, sending a full tablet report...
I20260807 06:45:44.389655 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.383609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42331 (local address 127.0.0.1:39148)
0807 06:45:44.384590 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.384630 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.384700 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.385528 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.385532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.385535 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.385610 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.385613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.387134 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.387135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.388379 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.388382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.389355 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.389356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.389435 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.389447 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.389521 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.389586 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"thread_start_us":94,"threads_started":1}
I20260807 06:45:44.389689 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.383853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39148 (local address 127.11.137.129:42331)
0807 06:45:44.385331 (+ 1478us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.385335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.385346 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:45:44.385386 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.385388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.385404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.385855 (+ 451us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.385912 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.387036 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.388473 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.389267 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.389343 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.389393 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.389576 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.389618 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1440,"thread_start_us":76,"threads_started":1}
I20260807 06:45:44.390247 2399 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f5878ad7324604b2139f33d81a1368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:39148
I20260807 06:45:44.390800 2516 tablet_replica.cc:330] stopping tablet replica
I20260807 06:45:44.390901 2516 raft_consensus.cc:2229] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:45:44.390966 2516 raft_consensus.cc:2258] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:44.391309 2516 ts_tablet_manager.cc:1905] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:44.393540 2516 ts_tablet_manager.cc:1918] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:44.393616 2516 log.cc:1196] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/89f5878ad7324604b2139f33d81a1368
I20260807 06:45:44.393863 2516 ts_tablet_manager.cc:1939] T 89f5878ad7324604b2139f33d81a1368 P bad5a920312a401594de9642b6fb0576: Deleting consensus metadata
I20260807 06:45:44.394385 2186 catalog_manager.cc:4841] TS bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331): tablet 89f5878ad7324604b2139f33d81a1368 (table test-table [id=638435f7ee8a40249445d352ff98676c]) successfully deleted
W20260807 06:45:44.463392 2510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:44.463690 2510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:44.463749 2510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:44.465158 2510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:44.465204 2510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:44.465286 2510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:45:44.466840 2510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:38179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=44057
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:44.467103 2510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:44.467344 2510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:44.472692 2525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.472723 2527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.472818 2510 server_base.cc:1034] running on GCE node
W20260807 06:45:44.472702 2524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.473289 2510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:44.473556 2510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:44.474707 2510 hybrid_clock.cc:648] HybridClock initialized: now 1786085144474696 us; error 30 us; skew 500 ppm
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:44.477876 2510 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:45:44.478387 2510 webserver.cc:460] Webserver started at http://127.11.137.130:44057/ using document root <none> and password file <none>
I20260807 06:45:44.478695 2510 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:44.478819 2510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:44.480185 2510 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:44.480777 2541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.480960 2510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:45:44.481084 2510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "e0b209422ecb4e68a61e21a84458d6fc"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "209dbf931fc1d5383707989be932e5c4"
server_key_iv: "df6cf94964379e51c3e0137bbc2e8188"
server_key_version: "encryptionkey@0"
I20260807 06:45:44.481532 2510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:44.523233 2510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:44.525305 2510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:44.525481 2510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:44.525755 2510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:44.526088 2510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:44.526145 2510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.526191 2510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:44.526217 2510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.532408 2510 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:38179
I20260807 06:45:44.532449 2723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:38179 every 8 connection(s)
I20260807 06:45:44.532857 2510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:44.541915 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.533665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:36987 (local address 127.11.137.190:46581)
0807 06:45:44.533733 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.533736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.534018 (+ 282us) server_negotiation.cc:407] Connection header received
0807 06:45:44.534545 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.534547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.534561 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.534613 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:44.535529 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.536001 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.536982 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.537186 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.537295 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.539371 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:44.539372 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:44.539372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:44.539379 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:44.540608 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.541009 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.541010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.541010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.541059 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.541373 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.541373 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.541374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.541477 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:44.541540 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.541782 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.541850 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:45:44.542085 2726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.533658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:36987)
0807 06:45:44.533892 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.533932 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.534459 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.534667 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.534670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.535254 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:44.535453 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.535457 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.536081 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.536082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.536904 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.536905 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.537319 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.537320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.537432 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.537895 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:44.537902 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:44.539283 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:44.540701 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:44.540707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:44.540709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:44.540940 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:44.541121 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:44.541121 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:44.541122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:44.541299 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:44.541547 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:44.541552 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:44.541670 (+ 118us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.541754 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.541868 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260807 06:45:44.542271 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 2510
I20260807 06:45:44.542567 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:40123
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:46581
--webserver_port=38789
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:44.542645 2724 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46581
I20260807 06:45:44.542735 2724 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:44.542919 2724 heartbeater.cc:511] Master 127.11.137.190:46581 requested a full tablet report, sending...
I20260807 06:45:44.543363 2205 ts_manager.cc:194] Registered new tserver with Master: e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
I20260807 06:45:44.543723 2205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:36987
W20260807 06:45:44.627287 2727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:44.627550 2727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:44.627586 2727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:44.628695 2727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:44.628782 2727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:44.628826 2727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:45:44.630257 2727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:40123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=38789
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:44.630512 2727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:44.630743 2727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:44.635735 2734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.635748 2736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.635743 2733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.635912 2727 server_base.cc:1034] running on GCE node
I20260807 06:45:44.636173 2727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:44.636418 2727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:44.637586 2727 hybrid_clock.cc:648] HybridClock initialized: now 1786085144637578 us; error 49 us; skew 500 ppm
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:44.640283 2727 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:45:44.640726 2727 webserver.cc:460] Webserver started at http://127.11.137.131:38789/ using document root <none> and password file <none>
I20260807 06:45:44.640954 2727 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:44.641083 2727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:44.642484 2727 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:44.643275 2749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.643502 2727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:44.643617 2727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "0e0f9131012a4a078391e5e1d34dfa5f"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "c68a71512585c6db4bf4b56e9f736621"
server_key_iv: "4fffe6f62604721f759e049c5a8f8cc1"
server_key_version: "encryptionkey@0"
I20260807 06:45:44.643960 2727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:44.654371 2727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:44.656085 2727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:44.656234 2727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:44.656484 2727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:44.656840 2727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:44.656903 2727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.656939 2727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:44.656966 2727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.662997 2727 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:40123
I20260807 06:45:44.663049 2916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:40123 every 8 connection(s)
I20260807 06:45:44.663369 2727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:45:44.668731 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 2727
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:45:44.673652 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.664080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:60717 (local address 127.11.137.190:46581)
0807 06:45:44.664159 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.664162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.664383 (+ 221us) server_negotiation.cc:407] Connection header received
0807 06:45:44.664924 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.664925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.664938 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.665006 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:44.666075 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.666575 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.667577 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.667794 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.667871 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.670371 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:44.670373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:44.670373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:44.670380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:44.671948 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.672456 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.672457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.672457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.672522 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.672878 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.672879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.672880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.673041 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:44.673119 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.673435 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.673529 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:45:44.673678 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.664087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:60717)
0807 06:45:44.664259 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.664293 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.664813 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.665084 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.665088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.665782 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:44.665967 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.665973 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.666676 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.666678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.667481 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.667483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.667890 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.667891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.668025 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.668540 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:44.668548 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:44.670269 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:44.672054 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:44.672062 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:44.672064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:44.672358 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:44.672617 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:44.672618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:44.672618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:44.672782 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:44.673119 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:44.673125 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:44.673294 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.673383 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.673519 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260807 06:45:44.674230 2917 heartbeater.cc:347] Connected to a master server at 127.11.137.190:46581
I20260807 06:45:44.674345 2917 heartbeater.cc:464] Registering TS with master...
I20260807 06:45:44.674525 2917 heartbeater.cc:511] Master 127.11.137.190:46581 requested a full tablet report, sending...
I20260807 06:45:44.674984 2205 ts_manager.cc:194] Registered new tserver with Master: 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123)
I20260807 06:45:44.675478 2205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:60717
I20260807 06:45:44.676753 2922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.669243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50222 (local address 127.11.137.190:46581)
0807 06:45:44.669369 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.669371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.669457 (+ 86us) server_negotiation.cc:407] Connection header received
0807 06:45:44.669490 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.669491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.669504 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.669603 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:44.670247 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.670908 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.672076 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.672387 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.672452 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.673908 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:44.673909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:44.673910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:44.673916 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:44.675587 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.675941 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.675942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.675942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.676010 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:44.676231 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:44.676232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:44.676233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:44.676344 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:44.676521 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.676558 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.676645 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260807 06:45:44.677484 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:45:44.680032 2922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.677804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50236 (local address 127.11.137.190:46581)
0807 06:45:44.677876 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.677877 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.677973 (+ 96us) server_negotiation.cc:407] Connection header received
0807 06:45:44.678019 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.678020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.678046 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.678103 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:45:44.678167 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.678583 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.679353 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.679533 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.679589 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.679742 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:45:44.679826 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:45:44.679887 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.679923 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.679939 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:45:44.680326 2205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:45:44.682034 2205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:45:44.684271 2399 tablet_service.cc:1467] Processing CreateTablet for tablet 303a60ea3d6b4eaf9968a773f6c6cc74 (DEFAULT_TABLE table=test-table [id=52c81564e55141419751f8bc231f6adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:44.684505 2399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 303a60ea3d6b4eaf9968a773f6c6cc74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:44.685819 2338 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Bootstrap starting.
I20260807 06:45:44.686169 2338 tablet_bootstrap.cc:654] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:44.686806 2338 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: No bootstrap required, opened a new log
I20260807 06:45:44.686854 2338 ts_tablet_manager.cc:1397] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:45:44.686950 2338 raft_consensus.cc:348] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.687011 2338 raft_consensus.cc:374] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:44.687053 2338 raft_consensus.cc:729] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad5a920312a401594de9642b6fb0576, State: Initialized, Role: FOLLOWER
I20260807 06:45:44.687110 2338 consensus_queue.cc:260] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.687182 2338 ts_tablet_manager.cc:1428] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.689210 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.684024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59386 (local address 127.11.137.131:40123)
0807 06:45:44.685862 (+ 1838us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.685867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.685879 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:45:44.685915 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.685917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.685932 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.686034 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.686185 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.687225 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.688238 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.688849 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.688909 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.688944 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.689102 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.689132 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1785,"thread_start_us":133,"threads_started":1}
I20260807 06:45:44.689190 2928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.683924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40123 (local address 127.0.0.1:59386)
0807 06:45:44.684212 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.684221 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.684257 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.686043 (+ 1786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.686044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.686046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.686091 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.686093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.687334 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.687335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.688147 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.688150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.688929 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.688930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.688990 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.688994 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.689057 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.689102 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":17,"thread_start_us":85,"threads_started":1}
I20260807 06:45:44.689531 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.683924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38179 (local address 127.0.0.1:50422)
0807 06:45:44.684062 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.684073 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.684118 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.686324 (+ 2206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.686325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.686326 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.686360 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.686361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.687669 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.687670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.688430 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.688432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.689270 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.689271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.689339 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.689342 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.689400 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.689459 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260807 06:45:44.689853 2931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.684057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50422 (local address 127.11.137.130:38179)
0807 06:45:44.686171 (+ 2114us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.686175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.686184 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:45:44.686226 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.686228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.686239 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.686327 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.686423 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.687530 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.688571 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.689157 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.689262 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.689325 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.689727 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.689774 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2074,"thread_start_us":105,"threads_started":1}
I20260807 06:45:44.690313 2824 tablet_service.cc:1467] Processing CreateTablet for tablet 303a60ea3d6b4eaf9968a773f6c6cc74 (DEFAULT_TABLE table=test-table [id=52c81564e55141419751f8bc231f6adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:44.690488 2615 tablet_service.cc:1467] Processing CreateTablet for tablet 303a60ea3d6b4eaf9968a773f6c6cc74 (DEFAULT_TABLE table=test-table [id=52c81564e55141419751f8bc231f6adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:45:44.690642 2824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 303a60ea3d6b4eaf9968a773f6c6cc74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:44.690828 2615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 303a60ea3d6b4eaf9968a773f6c6cc74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:45:44.693547 2935 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Bootstrap starting.
I20260807 06:45:44.693807 2936 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Bootstrap starting.
I20260807 06:45:44.694388 2935 tablet_bootstrap.cc:654] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:44.694487 2936 tablet_bootstrap.cc:654] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Neither blocks nor log segments found. Creating new log.
I20260807 06:45:44.695071 2935 log.cc:824] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:44.695115 2936 log.cc:824] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:44.695919 2935 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: No bootstrap required, opened a new log
I20260807 06:45:44.695912 2936 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: No bootstrap required, opened a new log
I20260807 06:45:44.695991 2935 ts_tablet_manager.cc:1397] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:45:44.695991 2936 ts_tablet_manager.cc:1397] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:45:44.697957 2935 raft_consensus.cc:348] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.697957 2936 raft_consensus.cc:348] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.698130 2936 raft_consensus.cc:374] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:44.698130 2935 raft_consensus.cc:374] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:45:44.698169 2935 raft_consensus.cc:729] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0f9131012a4a078391e5e1d34dfa5f, State: Initialized, Role: FOLLOWER
I20260807 06:45:44.698169 2936 raft_consensus.cc:729] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b209422ecb4e68a61e21a84458d6fc, State: Initialized, Role: FOLLOWER
I20260807 06:45:44.698294 2935 consensus_queue.cc:260] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.698294 2936 consensus_queue.cc:260] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.698582 2935 ts_tablet_manager.cc:1428] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:45:44.698582 2936 ts_tablet_manager.cc:1428] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:45:44.698733 2724 heartbeater.cc:503] Master 127.11.137.190:46581 was elected leader, sending a full tablet report...
I20260807 06:45:44.698618 2917 heartbeater.cc:503] Master 127.11.137.190:46581 was elected leader, sending a full tablet report...
W20260807 06:45:44.783540 2725 tablet.cc:2369] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:45:44.783823 2942 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:44.783943 2942 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.784346 2942 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179), bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331)
I20260807 06:45:44.787663 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.784982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:58697 (local address 127.11.137.129:42331)
0807 06:45:44.785063 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.785066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.785076 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:45:44.785106 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.785107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.785119 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.785185 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.785368 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.785848 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.786901 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.787275 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.787344 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.787351 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.787534 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.787586 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:45:44.787680 2943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.784722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42331 (local address 127.11.137.131:58697)
0807 06:45:44.784888 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.784900 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.784946 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.785202 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.785203 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.785205 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.785295 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.785296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.785946 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.785947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.786807 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.786809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.787369 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.787370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.787454 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.787458 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.787524 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.787558 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
I20260807 06:45:44.787746 2931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.784642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:53181 (local address 127.11.137.130:38179)
0807 06:45:44.784691 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.784693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.784707 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:45:44.784789 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.784790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.784800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.784892 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:45:44.785143 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.785795 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.786811 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.787341 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.787425 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.787434 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.787620 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.787664 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:45:44.788244 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.784583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38179 (local address 127.11.137.131:53181)
0807 06:45:44.784646 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.784660 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:44.784711 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:44.784901 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:44.784903 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:44.784905 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:45:44.785050 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.785054 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.785878 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.785879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.786707 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:44.786710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.787440 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.787441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:44.787531 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.787535 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:45:44.787600 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:45:44.787637 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":39}
I20260807 06:45:44.788267 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "303a60ea3d6b4eaf9968a773f6c6cc74" candidate_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad5a920312a401594de9642b6fb0576" is_pre_election: true
I20260807 06:45:44.788497 2428 raft_consensus.cc:2454] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0f9131012a4a078391e5e1d34dfa5f in term 0.
I20260807 06:45:44.788643 2645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "303a60ea3d6b4eaf9968a773f6c6cc74" candidate_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b209422ecb4e68a61e21a84458d6fc" is_pre_election: true
I20260807 06:45:44.788794 2752 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0f9131012a4a078391e5e1d34dfa5f, bad5a920312a401594de9642b6fb0576; no voters:
I20260807 06:45:44.788841 2645 raft_consensus.cc:2454] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0f9131012a4a078391e5e1d34dfa5f in term 0.
I20260807 06:45:44.788964 2942 raft_consensus.cc:2781] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:45:44.789042 2942 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:45:44.789073 2942 raft_consensus.cc:3037] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:44.789919 2942 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.790082 2942 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [CANDIDATE]: Term 1 election: Requested vote from peers e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179), bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331)
I20260807 06:45:44.790290 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "303a60ea3d6b4eaf9968a773f6c6cc74" candidate_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad5a920312a401594de9642b6fb0576"
I20260807 06:45:44.790306 2645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "303a60ea3d6b4eaf9968a773f6c6cc74" candidate_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b209422ecb4e68a61e21a84458d6fc"
I20260807 06:45:44.790385 2645 raft_consensus.cc:3037] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:44.790385 2428 raft_consensus.cc:3037] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:45:44.791379 2428 raft_consensus.cc:2454] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0f9131012a4a078391e5e1d34dfa5f in term 1.
I20260807 06:45:44.791379 2645 raft_consensus.cc:2454] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0f9131012a4a078391e5e1d34dfa5f in term 1.
I20260807 06:45:44.791608 2752 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0f9131012a4a078391e5e1d34dfa5f, bad5a920312a401594de9642b6fb0576; no voters:
I20260807 06:45:44.791719 2942 raft_consensus.cc:2781] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:45:44.792268 2942 raft_consensus.cc:686] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 LEADER]: Becoming Leader. State: Replica: 0e0f9131012a4a078391e5e1d34dfa5f, State: Running, Role: LEADER
I20260807 06:45:44.792374 2942 consensus_queue.cc:237] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:44.793383 2205 catalog_manager.cc:5495] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131). New cstate: current_term: 1 leader_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } health_report { overall_health: UNKNOWN } } }
I20260807 06:45:44.804930 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.802796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59390 (local address 127.11.137.131:40123)
0807 06:45:44.802852 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:44.802854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:44.802865 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:45:44.802921 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:44.802922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:44.802939 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:44.803007 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:45:44.803141 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.803585 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.804245 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:44.804432 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:44.804503 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:44.804654 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:45:44.804749 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:45:44.804810 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:44.804846 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 06:45:44.804862 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 06:45:44.806964 2645 raft_consensus.cc:1261] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Refusing update from remote peer 0e0f9131012a4a078391e5e1d34dfa5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:44.807001 2428 raft_consensus.cc:1261] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Refusing update from remote peer 0e0f9131012a4a078391e5e1d34dfa5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:45:44.807374 2945 consensus_queue.cc:1035] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:44.807546 2942 consensus_queue.cc:1035] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:45:44.809991 2953 mvcc.cc:205] Tried to move back new op lower bound from 7315804753126182912 to 7315804753070399488. Current Snapshot: MvccSnapshot[applied={T|T < 7315804753126182912}]
I20260807 06:45:44.810889 2952 mvcc.cc:205] Tried to move back new op lower bound from 7315804753126182912 to 7315804753070399488. Current Snapshot: MvccSnapshot[applied={T|T < 7315804753126182912 or (T in {7315804753126182912})}]
I20260807 06:45:44.812008 2204 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:45:44.812107 2204 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:45:44.812896 2204 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Sending DeleteTablet for 3 replicas of tablet 303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:44.813205 2824 tablet_service.cc:1514] Processing DeleteTablet for tablet 303a60ea3d6b4eaf9968a773f6c6cc74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:59386
I20260807 06:45:44.813246 2615 tablet_service.cc:1514] Processing DeleteTablet for tablet 303a60ea3d6b4eaf9968a773f6c6cc74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:50422
I20260807 06:45:44.813282 2399 tablet_service.cc:1514] Processing DeleteTablet for tablet 303a60ea3d6b4eaf9968a773f6c6cc74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:45:44 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:39148
I20260807 06:45:44.813378 2516 tablet_replica.cc:330] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: stopping tablet replica
I20260807 06:45:44.813448 2516 raft_consensus.cc:2229] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:45:44.813469 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 2274
I20260807 06:45:44.813496 2516 raft_consensus.cc:2258] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:44.813490 2967 tablet_replica.cc:330] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: stopping tablet replica
I20260807 06:45:44.813582 2967 raft_consensus.cc:2229] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:45:44.813665 2967 raft_consensus.cc:2258] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:44.814052 2967 ts_tablet_manager.cc:1905] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:44.815824 2967 ts_tablet_manager.cc:1918] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:44.815914 2967 log.cc:1196] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:44.816172 2967 ts_tablet_manager.cc:1939] T 303a60ea3d6b4eaf9968a773f6c6cc74 P 0e0f9131012a4a078391e5e1d34dfa5f: Deleting consensus metadata
I20260807 06:45:44.816540 2188 catalog_manager.cc:4841] TS 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): tablet 303a60ea3d6b4eaf9968a773f6c6cc74 (table test-table [id=52c81564e55141419751f8bc231f6adf]) successfully deleted
I20260807 06:45:44.816699 2968 tablet_replica.cc:330] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: stopping tablet replica
I20260807 06:45:44.816792 2968 raft_consensus.cc:2229] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:45:44.816883 2968 raft_consensus.cc:2258] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:45:44.824626 2968 ts_tablet_manager.cc:1905] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:45:44.826575 2968 ts_tablet_manager.cc:1918] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:45:44.826663 2968 log.cc:1196] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:44.826967 2968 ts_tablet_manager.cc:1939] T 303a60ea3d6b4eaf9968a773f6c6cc74 P e0b209422ecb4e68a61e21a84458d6fc: Deleting consensus metadata
I20260807 06:45:44.827504 2186 catalog_manager.cc:4841] TS e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): tablet 303a60ea3d6b4eaf9968a773f6c6cc74 (table test-table [id=52c81564e55141419751f8bc231f6adf]) successfully deleted
W20260807 06:45:44.829520 2186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:42331 (error 108)
I20260807 06:45:44.829826 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 2510
I20260807 06:45:44.831972 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:44.829959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42331 (local address 127.0.0.1:39160)
0807 06:45:44.831860 (+ 1901us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:44.831924 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1869}
W20260807 06:45:44.832203 2186 catalog_manager.cc:4584] TS bad5a920312a401594de9642b6fb0576 (127.11.137.129:42331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 303a60ea3d6b4eaf9968a773f6c6cc74: Network error: Client connection negotiation failed: client connection to 127.11.137.129:42331: connect: Connection refused (error 111)
I20260807 06:45:44.839676 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 2727
I20260807 06:45:44.850981 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 2155
I20260807 06:45:44.860512 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46581
--webserver_interface=127.11.137.190
--webserver_port=38283
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:46581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:45:44.947007 2973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:44.947227 2973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:44.947249 2973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:44.948418 2973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:45:44.948464 2973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:44.948478 2973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:44.948530 2973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:45:44.948549 2973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:45:44.950049 2973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:46581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:46581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=38283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:44.950326 2973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:44.950577 2973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:44.955660 2981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.955698 2987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:44.955699 2982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:44.956090 2973 server_base.cc:1034] running on GCE node
I20260807 06:45:44.956368 2973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:44.956705 2973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:44.957870 2973 hybrid_clock.cc:648] HybridClock initialized: now 1786085144957865 us; error 38 us; skew 500 ppm
Aug 07 06:45:44 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:44.960340 2973 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:45:44.960784 2973 webserver.cc:460] Webserver started at http://127.11.137.190:38283/ using document root <none> and password file <none>
I20260807 06:45:44.961022 2973 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:44.961105 2973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:44.962546 2973 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:44.963267 3000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:44.963449 2973 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:44.963558 2973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3f6b02a2cbf53778eca14fcfe2fc2379"
server_key_iv: "f9c3fcc4a83cdd9de029171280734831"
server_key_version: "encryptionkey@0"
I20260807 06:45:44.963961 2973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:44.976909 2973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:44.978914 2973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:44.979100 2973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:44.983500 2973 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:46581
I20260807 06:45:44.983541 3085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:46581 every 8 connection(s)
I20260807 06:45:44.983925 2973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:45:44.985658 3086 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:45:44.986146 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 2973
I20260807 06:45:44.986342 3086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap starting.
I20260807 06:45:44.986464 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:42331
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:46581
--webserver_port=37341
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:44.995826 3086 log.cc:824] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:44.998225 3086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:45:44.998557 3086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b: Bootstrap complete.
I20260807 06:45:45.000892 3086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:45.001124 3086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76e0fb31ae8b4287bb7d5a3d28b72d2b, State: Initialized, Role: FOLLOWER
I20260807 06:45:45.001332 3086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:45.001400 3086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:45:45.001466 3086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:45:45.001514 3086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:45:45.002575 3086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:45.002668 3086 leader_election.cc:302] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76e0fb31ae8b4287bb7d5a3d28b72d2b; no voters:
I20260807 06:45:45.002908 3086 leader_election.cc:288] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 06:45:45.002947 3090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:45:45.003078 3090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [term 3 LEADER]: Becoming Leader. State: Replica: 76e0fb31ae8b4287bb7d5a3d28b72d2b, State: Running, Role: LEADER
I20260807 06:45:45.003170 3090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } }
I20260807 06:45:45.003211 3086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:45:45.003620 3092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76e0fb31ae8b4287bb7d5a3d28b72d2b. Latest consensus state: current_term: 3 leader_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } } }
I20260807 06:45:45.003715 3092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:45.003957 3096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:45:45.004454 3091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e0fb31ae8b4287bb7d5a3d28b72d2b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 46581 } } }
I20260807 06:45:45.004597 3091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76e0fb31ae8b4287bb7d5a3d28b72d2b [sys.catalog]: This master's current role is: LEADER
I20260807 06:45:45.004825 3096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:45:45.004921 3096 catalog_manager.cc:1259] Loaded cluster ID: 59c57e95516341c4846a28d5a575660e
I20260807 06:45:45.004948 3096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 06:45:45.005306 3096 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f46f7d129ad google::LogMessage::Fail() at ??:0
@ 0x7f46f7d1588a google::LogMessage::SendToLog() at ??:0
@ 0x7f46f7d124de google::LogMessage::Flush() at ??:0
@ 0x7f46f7d13a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f46ffc330f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f46ffc3c8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f46f9be00d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f46f9bd5954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f46faa396db start_thread at ??:0
@ 0x7f46f681061f clone at ??:0
W20260807 06:45:45.084841 3088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:45.085054 3088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:45.085078 3088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:45.086266 3088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:45.086318 3088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:45.086346 3088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:45:45.087862 3088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:42331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=37341
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:45.088124 3088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:45.088387 3088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:45.094873 3133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:45.094914 3134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:45.095041 3137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:45.095257 3088 server_base.cc:1034] running on GCE node
I20260807 06:45:45.095520 3088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:45.095804 3088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:45.096964 3088 hybrid_clock.cc:648] HybridClock initialized: now 1786085145096954 us; error 30 us; skew 500 ppm
Aug 07 06:45:45 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:45.099831 3088 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:45:45.100310 3088 webserver.cc:460] Webserver started at http://127.11.137.129:37341/ using document root <none> and password file <none>
I20260807 06:45:45.100543 3088 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:45.100620 3088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:45.102110 3088 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:45.102820 3149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.103086 3088 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:45.103195 3088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "bad5a920312a401594de9642b6fb0576"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "3d951f56877ad2bf3ae833abb85413c3"
server_key_iv: "8d31ead30018840fd5e9b6b974ae5e2e"
server_key_version: "encryptionkey@0"
I20260807 06:45:45.103650 3088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:45.126313 3088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:45.128997 3088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:45.129171 3088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:45.129534 3088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:45.130102 3159 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:45:45.131712 3088 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:45:45.131795 3088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 06:45:45.131832 3088 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:45:45.132755 3088 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:45:45.132804 3088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 06:45:45.132903 3159 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Bootstrap starting.
I20260807 06:45:45.140506 3088 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:42331
I20260807 06:45:45.140599 3323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:42331 every 8 connection(s)
I20260807 06:45:45.140980 3088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:45:45.143867 3159 log.cc:824] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Log is configured to *not* fsync() on all Append() calls
I20260807 06:45:45.146175 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 3088
I20260807 06:45:45.146219 3159 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:45:45.146499 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:38179
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:46581
--webserver_port=44057
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:45.146535 3159 tablet_bootstrap.cc:492] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Bootstrap complete.
I20260807 06:45:45.147737 3159 ts_tablet_manager.cc:1397] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260807 06:45:45.149040 3159 raft_consensus.cc:348] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:45.149363 3159 raft_consensus.cc:729] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad5a920312a401594de9642b6fb0576, State: Initialized, Role: FOLLOWER
I20260807 06:45:45.149542 3159 consensus_queue.cc:260] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:45.149824 3159 ts_tablet_manager.cc:1428] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260807 06:45:45.212483 3329 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:45:45.141824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:57875)
0807 06:45:45.142087 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.142137 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:45.142783 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:45.212266 (+ 69483us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":137,"threads_started":1}
W20260807 06:45:45.212797 3324 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:46581 (0 consecutive failures): Network error: Failed to ping master at 127.11.137.190:46581: Client connection negotiation failed: client connection to 127.11.137.190:46581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:45:45.213186 3329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.213052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:43055)
0807 06:45:45.213108 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.213159 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 06:45:45.213552 3329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.213457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:43693)
0807 06:45:45.213504 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.213533 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 06:45:45.213706 3324 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:45:45.234249 3331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:45.234447 3331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:45.234470 3331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:45.235638 3331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:45.235682 3331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:45.235738 3331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:45:45.237347 3331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:38179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=44057
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:45.237599 3331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:45.237857 3331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:45.242971 3344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:45.242981 3345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:45.242981 3347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:45.243324 3331 server_base.cc:1034] running on GCE node
I20260807 06:45:45.243525 3331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:45.243789 3331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:45.244931 3331 hybrid_clock.cc:648] HybridClock initialized: now 1786085145244911 us; error 38 us; skew 500 ppm
Aug 07 06:45:45 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:45.247500 3331 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:45:45.247956 3331 webserver.cc:460] Webserver started at http://127.11.137.130:44057/ using document root <none> and password file <none>
I20260807 06:45:45.248154 3331 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:45.248202 3331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:45.249529 3331 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:45:45.250108 3358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.250303 3331 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:45:45.250415 3331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "e0b209422ecb4e68a61e21a84458d6fc"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "209dbf931fc1d5383707989be932e5c4"
server_key_iv: "df6cf94964379e51c3e0137bbc2e8188"
server_key_version: "encryptionkey@0"
I20260807 06:45:45.250775 3331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:45.261868 3331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:45.263803 3331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:45.263960 3331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:45.264194 3331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:45.264518 3331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:45.264573 3331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.264608 3331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:45.264639 3331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.270907 3331 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:38179
I20260807 06:45:45.270957 3528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:38179 every 8 connection(s)
I20260807 06:45:45.271298 3331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:45:45.272316 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.271935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:43667)
0807 06:45:45.272100 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.272180 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
W20260807 06:45:45.272728 3529 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:46581 (0 consecutive failures): Network error: Failed to ping master at 127.11.137.190:46581: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
I20260807 06:45:45.272987 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 3331
I20260807 06:45:45.273025 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.272911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:55401)
0807 06:45:45.272973 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.272997 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 06:45:45.273303 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:40123
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:46581
--webserver_port=38789
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:45:45.273365 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.273281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:45511)
0807 06:45:45.273311 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.273335 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260807 06:45:45.273471 3529 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:45:45.356427 3533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:45:45.356637 3533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:45:45.356659 3533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:45:45.357834 3533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:45:45.357877 3533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:45:45.357903 3533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:45:45.359359 3533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:40123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=38789
--tserver_master_addrs=127.11.137.190:46581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:45:45.359606 3533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:45:45.359853 3533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:45:45.364876 3545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:45.364907 3547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:45:45.364831 3549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:45:45.365106 3533 server_base.cc:1034] running on GCE node
I20260807 06:45:45.365372 3533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:45:45.365621 3533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:45:45.366761 3533 hybrid_clock.cc:648] HybridClock initialized: now 1786085145366751 us; error 26 us; skew 500 ppm
Aug 07 06:45:45 dist-test-slave-8hhm krb5kdc[1289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:45:45.369436 3533 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:45:45.369820 3533 webserver.cc:460] Webserver started at http://127.11.137.131:38789/ using document root <none> and password file <none>
I20260807 06:45:45.369997 3533 fs_manager.cc:359] Metadata directory not provided
I20260807 06:45:45.370036 3533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:45:45.371287 3533 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:45:45.371850 3560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.372031 3533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.372133 3533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "0e0f9131012a4a078391e5e1d34dfa5f"
format_stamp: "Formatted at 2026-08-07 06:45:43 on dist-test-slave-8hhm"
server_key: "c68a71512585c6db4bf4b56e9f736621"
server_key_iv: "4fffe6f62604721f759e049c5a8f8cc1"
server_key_version: "encryptionkey@0"
I20260807 06:45:45.372490 3533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:45:45.392493 3533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:45:45.394397 3533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:45:45.394562 3533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:45:45.394805 3533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:45:45.395113 3533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:45:45.395169 3533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.395242 3533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:45:45.395274 3533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:45:45.401305 3533 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:40123
I20260807 06:45:45.401369 3735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:40123 every 8 connection(s)
I20260807 06:45:45.401742 3533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:45:45.402817 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.402435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:49745)
0807 06:45:45.402600 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.402677 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
W20260807 06:45:45.403247 3736 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:46581 (0 consecutive failures): Network error: Failed to ping master at 127.11.137.190:46581: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
I20260807 06:45:45.403507 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.403418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:60765)
0807 06:45:45.403463 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.403489 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 06:45:45.403803 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:45.403726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:41311)
0807 06:45:45.403767 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:45.403789 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 06:45:45.403924 3736 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:45:45.409052 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 3533
I20260807 06:45:46.214253 3745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.214016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:57333)
0807 06:45:46.214150 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:46.214184 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260807 06:45:46.274006 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.273807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:53229)
0807 06:45:46.273923 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:46.273956 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260807 06:45:46.404491 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.404286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:58755)
0807 06:45:46.404400 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:46.404434 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260807 06:45:46.522979 3750 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:46.523109 3750 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:46.523437 3750 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123), e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
Aug 07 06:45:46 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.131@KRBTEST.COM
Aug 07 06:45:46 dist-test-slave-8hhm krb5kdc[1289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.130@KRBTEST.COM
I20260807 06:45:46.534044 3752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.523685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:50735 (local address 127.11.137.131:40123)
0807 06:45:46.523867 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:46.523880 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:46.523926 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:45:46.524376 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:46.524378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:46.524419 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:46.524616 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:46.525424 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.526262 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.527225 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.527624 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.527745 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:46.530237 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:46.530241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:46.530242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:46.530254 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:46.532204 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:46.532696 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:46.532699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:46.532699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:46.532806 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:46.533074 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:46.533076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:46.533076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:46.533389 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:46.533494 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:46.533806 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 06:45:46.533927 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":83,"threads_started":1}
I20260807 06:45:46.534032 3745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.523591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:40123 (local address 127.11.137.129:50735)
0807 06:45:46.523635 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:46.523648 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:46.523709 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:46.524643 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:46.524646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:46.525073 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:46.525284 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:46.525290 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.526378 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.526379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:46.527132 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:46.527134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.527717 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.527718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:46.527828 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:46.528484 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:46.528488 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:46.530114 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:46.532312 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:46.532319 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:46.532320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:46.532570 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:46.532888 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:46.532889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:46.532889 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:46.532994 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:46.533478 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:46.533485 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:46.533606 (+ 121us) client_negotiation.cc:769] Sending connection context
0807 06:45:46.533716 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:45:46.533939 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":60}
I20260807 06:45:46.534080 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.523783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:39765 (local address 127.11.137.130:38179)
0807 06:45:46.523931 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:45:46.523939 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:45:46.523964 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:45:46.524384 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:45:46.524386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:45:46.524421 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:45:46.524591 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:45:46.525409 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.526259 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.527242 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.527628 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.527772 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:46.530550 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:45:46.530555 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:45:46.530555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:45:46.530567 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:45:46.532388 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:46.532757 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:46.532760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:46.532760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:46.532860 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:45:46.533079 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:45:46.533080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:45:46.533080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:45:46.533390 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:45:46.533490 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:45:46.533812 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 06:45:46.533961 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":40,"threads_started":1}
I20260807 06:45:46.534160 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:46.523643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:38179 (local address 127.11.137.129:39765)
0807 06:45:46.523778 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:46.523786 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 06:45:46.523826 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:45:46.524643 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:45:46.524646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:45:46.525071 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:45:46.525285 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:46.525291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.526365 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.526366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:46.527130 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:45:46.527132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:45:46.527733 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:45:46.527734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:45:46.527830 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:45:46.528416 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:45:46.528425 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:45:46.530447 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:45:46.532474 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:46.532475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:46.532475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:46.532659 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:46.532934 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:45:46.532935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:45:46.532935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:45:46.533001 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:45:46.533483 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:45:46.533490 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:45:46.533607 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 06:45:46.533717 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:45:46.534020 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":151,"thread_start_us":70,"threads_started":1}
W20260807 06:45:46.535236 3155 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
W20260807 06:45:46.535326 3151 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:46.535401 3151 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad5a920312a401594de9642b6fb0576; no voters: 0e0f9131012a4a078391e5e1d34dfa5f, e0b209422ecb4e68a61e21a84458d6fc
I20260807 06:45:46.535533 3750 raft_consensus.cc:2726] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:45:47.214919 3756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:47.214695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:59849)
0807 06:45:47.214832 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:47.214870 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260807 06:45:47.274644 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:47.274417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:39843)
0807 06:45:47.274573 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:47.274607 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260807 06:45:47.405161 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:47.404942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:50025)
0807 06:45:47.405085 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:47.405121 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260807 06:45:48.215581 3762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:48.215363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:40435)
0807 06:45:48.215492 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:48.215532 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260807 06:45:48.264135 3763 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:48.264261 3763 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:48.264456 3763 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123), e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
W20260807 06:45:48.264894 3151 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
W20260807 06:45:48.264995 3155 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:48.265092 3155 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad5a920312a401594de9642b6fb0576; no voters: 0e0f9131012a4a078391e5e1d34dfa5f, e0b209422ecb4e68a61e21a84458d6fc
I20260807 06:45:48.265200 3763 raft_consensus.cc:2726] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:45:48.275326 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:48.275085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:42183)
0807 06:45:48.275223 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:48.275259 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260807 06:45:48.406011 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:48.405605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:45899)
0807 06:45:48.405892 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:48.405965 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":66,"threads_started":1}
I20260807 06:45:49.216347 3770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:49.216094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:51947)
0807 06:45:49.216254 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:49.216297 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":70,"threads_started":1}
I20260807 06:45:49.275982 3771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:49.275740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:36837)
0807 06:45:49.275879 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:49.275927 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260807 06:45:49.406749 3772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:49.406538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:60483)
0807 06:45:49.406662 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:49.406705 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260807 06:45:50.217123 3774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:50.216900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:50711)
0807 06:45:50.217030 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:50.217070 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260807 06:45:50.276621 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:50.276409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:58375)
0807 06:45:50.276538 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:50.276579 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
I20260807 06:45:50.407467 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:50.407161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:34781)
0807 06:45:50.407311 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:50.407377 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":61,"threads_started":1}
I20260807 06:45:50.500434 3777 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:50.500540 3777 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:50.500746 3777 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123), e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
W20260807 06:45:50.501096 3151 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
W20260807 06:45:50.501188 3155 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:50.501235 3151 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad5a920312a401594de9642b6fb0576; no voters: 0e0f9131012a4a078391e5e1d34dfa5f, e0b209422ecb4e68a61e21a84458d6fc
I20260807 06:45:50.501322 3777 raft_consensus.cc:2726] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:45:51.217765 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:51.217533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:36521)
0807 06:45:51.217679 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:51.217717 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260807 06:45:51.277379 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:51.277121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:39197)
0807 06:45:51.277290 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:51.277332 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":64,"threads_started":1}
I20260807 06:45:51.408257 3782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:51.408038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:34117)
0807 06:45:51.408182 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:51.408215 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260807 06:45:52.218461 3783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:52.218222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:52085)
0807 06:45:52.218372 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:52.218411 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260807 06:45:52.278038 3784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:52.277809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:34551)
0807 06:45:52.277952 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:52.277991 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260807 06:45:52.408875 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:52.408659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:59135)
0807 06:45:52.408789 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:52.408832 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260807 06:45:53.219172 3787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:53.218921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:54427)
0807 06:45:53.219074 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:53.219123 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260807 06:45:53.278680 3788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:53.278494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:45685)
0807 06:45:53.278609 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:53.278640 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260807 06:45:53.409591 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:53.409371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:53421)
0807 06:45:53.409508 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:53.409546 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260807 06:45:54.105010 3793 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:54.105162 3793 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:54.105386 3793 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123), e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
W20260807 06:45:54.105963 3155 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
W20260807 06:45:54.106027 3151 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:54.106096 3151 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad5a920312a401594de9642b6fb0576; no voters: 0e0f9131012a4a078391e5e1d34dfa5f, e0b209422ecb4e68a61e21a84458d6fc
I20260807 06:45:54.106196 3793 raft_consensus.cc:2726] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:45:54.219873 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:54.219636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:47895)
0807 06:45:54.219784 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:54.219822 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260807 06:45:54.279335 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:54.279090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:57651)
0807 06:45:54.279242 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:54.279278 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260807 06:45:54.410446 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:54.410185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:41321)
0807 06:45:54.410317 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:54.410349 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260807 06:45:55.220669 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:55.220401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:32811)
0807 06:45:55.220581 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:55.220622 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":64,"threads_started":1}
I20260807 06:45:55.280033 3799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:55.279808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:58355)
0807 06:45:55.279945 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:55.279986 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260807 06:45:55.411134 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:55.410872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:44571)
0807 06:45:55.411042 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:55.411085 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":64,"threads_started":1}
I20260807 06:45:56.221400 3802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:56.221154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:37839)
0807 06:45:56.221313 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:56.221349 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260807 06:45:56.280805 3803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:56.280566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:44569)
0807 06:45:56.280718 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:56.280760 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260807 06:45:56.411904 3805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:56.411632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:42563)
0807 06:45:56.411816 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:56.411854 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":93,"threads_started":1}
I20260807 06:45:56.932317 3807 raft_consensus.cc:482] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:45:56.932416 3807 raft_consensus.cc:504] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0f9131012a4a078391e5e1d34dfa5f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 40123 } } peers { permanent_uuid: "e0b209422ecb4e68a61e21a84458d6fc" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 38179 } } peers { permanent_uuid: "bad5a920312a401594de9642b6fb0576" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42331 } }
I20260807 06:45:56.932629 3807 leader_election.cc:288] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123), e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179)
W20260807 06:45:56.933086 3151 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0b209422ecb4e68a61e21a84458d6fc (127.11.137.130:38179): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
W20260807 06:45:56.933180 3155 leader_election.cc:341] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0e0f9131012a4a078391e5e1d34dfa5f (127.11.137.131:40123): Not found: Tablet not found: 303a60ea3d6b4eaf9968a773f6c6cc74
I20260807 06:45:56.933244 3155 leader_election.cc:302] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad5a920312a401594de9642b6fb0576; no voters: 0e0f9131012a4a078391e5e1d34dfa5f, e0b209422ecb4e68a61e21a84458d6fc
I20260807 06:45:56.933334 3807 raft_consensus.cc:2726] T 303a60ea3d6b4eaf9968a773f6c6cc74 P bad5a920312a401594de9642b6fb0576 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:45:57.222105 3808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:57.221865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:57825)
0807 06:45:57.222008 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:57.222052 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260807 06:45:57.281509 3810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:57.281290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:58315)
0807 06:45:57.281414 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:57.281453 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260807 06:45:57.412586 3811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:57.412364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:40145)
0807 06:45:57.412501 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:57.412535 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260807 06:45:58.222859 3814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:58.222630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:57727)
0807 06:45:58.222777 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:58.222809 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
I20260807 06:45:58.282197 3815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:58.281991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:37455)
0807 06:45:58.282115 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:58.282150 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260807 06:45:58.413353 3816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:58.413109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:50525)
0807 06:45:58.413272 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:58.413307 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":60,"threads_started":1}
I20260807 06:45:59.223539 3818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:59.223304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:44475)
0807 06:45:59.223450 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:59.223487 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260807 06:45:59.282907 3819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:59.282659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:38547)
0807 06:45:59.282817 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:59.282859 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260807 06:45:59.414003 3820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:45:59.413775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:52285)
0807 06:45:59.413920 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:45:59.413955 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260807 06:46:00.224306 3822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:00.224082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.129:45929)
0807 06:46:00.224224 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:00.224258 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260807 06:46:00.283607 3823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:00.283408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.130:35323)
0807 06:46:00.283531 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:00.283560 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260807 06:46:00.414709 3824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:00.414479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:46581 (local address 127.11.137.131:33711)
0807 06:46:00.414631 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:00.414664 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:46581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260807 06:46:00.418274 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 3088
I20260807 06:46:00.432367 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 3331
I20260807 06:46:00.444829 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 3533
2026-08-07T06:46:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18586 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:46:00 dist-test-slave-8hhm krb5kdc[3827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:46:00 dist-test-slave-8hhm krb5kdc[3827](info): set up 2 sockets
Aug 07 06:46:00 dist-test-slave-8hhm krb5kdc[3827](info): commencing operation
krb5kdc: starting...
W20260807 06:46:01.700994 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:46:01 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:46:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:46:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:46:01.823835 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40307
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:40307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:01.909615 3849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:01.909822 3849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:01.909843 3849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:01.910980 3849 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:46:01.911026 3849 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:46:01.911038 3849 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:46:01.911051 3849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:46:01.911103 3849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:01.911119 3849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:01.911144 3849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:46:01.911172 3849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:46:01.912679 3849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:40307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:01.912917 3849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:01.913152 3849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:01.918184 3866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:01.918231 3849 server_base.cc:1034] running on GCE node
W20260807 06:46:01.918202 3862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:01.918197 3861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:01.918778 3849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:01.919039 3849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:01.920198 3849 hybrid_clock.cc:648] HybridClock initialized: now 1786085161920179 us; error 37 us; skew 500 ppm
Aug 07 06:46:01 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085161, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:01.922658 3849 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:46:01.923094 3849 webserver.cc:460] Webserver started at http://127.11.137.190:34613/ using document root <none> and password file <none>
I20260807 06:46:01.923352 3849 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:01.923395 3849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:01.923545 3849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:46:01.924605 3849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "e2851a0f41fc41b0a6898c9c293c9dc4"
format_stamp: "Formatted at 2026-08-07 06:46:01 on dist-test-slave-8hhm"
server_key: "aacaceada58b528d18136f010d0f4e06"
server_key_iv: "03f31aa21dca5204bcbb73c790dce017"
server_key_version: "encryptionkey@0"
I20260807 06:46:01.924988 3849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "e2851a0f41fc41b0a6898c9c293c9dc4"
format_stamp: "Formatted at 2026-08-07 06:46:01 on dist-test-slave-8hhm"
server_key: "aacaceada58b528d18136f010d0f4e06"
server_key_iv: "03f31aa21dca5204bcbb73c790dce017"
server_key_version: "encryptionkey@0"
I20260807 06:46:01.926429 3849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:46:01.927160 3873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:01.927366 3849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:46:01.927464 3849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "e2851a0f41fc41b0a6898c9c293c9dc4"
format_stamp: "Formatted at 2026-08-07 06:46:01 on dist-test-slave-8hhm"
server_key: "aacaceada58b528d18136f010d0f4e06"
server_key_iv: "03f31aa21dca5204bcbb73c790dce017"
server_key_version: "encryptionkey@0"
I20260807 06:46:01.927556 3849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:01.933813 3849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:01.935534 3849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:01.935685 3849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:01.939725 3849 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:40307
I20260807 06:46:01.939756 3961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:40307 every 8 connection(s)
I20260807 06:46:01.940105 3849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:46:01.940945 3962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:01.943369 3962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap starting.
I20260807 06:46:01.943960 3962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:01.944275 3962 log.cc:824] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:01.944954 3962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: No bootstrap required, opened a new log
I20260807 06:46:01.946560 3962 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:01.946702 3962 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:01.946748 3962 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2851a0f41fc41b0a6898c9c293c9dc4, State: Initialized, Role: FOLLOWER
I20260807 06:46:01.946916 3962 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:01.947002 3962 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:46:01.947054 3962 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:46:01.947103 3962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:01.947638 3962 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:01.947762 3962 leader_election.cc:302] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2851a0f41fc41b0a6898c9c293c9dc4; no voters:
I20260807 06:46:01.947937 3962 leader_election.cc:288] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:46:01.947975 3969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:46:01.948153 3969 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 LEADER]: Becoming Leader. State: Replica: e2851a0f41fc41b0a6898c9c293c9dc4, State: Running, Role: LEADER
I20260807 06:46:01.948203 3962 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:46:01.948290 3969 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:01.948676 3970 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } } }
I20260807 06:46:01.948791 3970 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 06:46:01.949039 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 3849
I20260807 06:46:01.949059 3976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:46:01.949136 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:46:01.949365 11814 external_mini_cluster.cc:1428] Setting key 80e0e4878fa178a73239452b2725642c
I20260807 06:46:01.949625 3976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:46:01.948680 3971 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2851a0f41fc41b0a6898c9c293c9dc4. Latest consensus state: current_term: 1 leader_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } } }
I20260807 06:46:01.950214 3971 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 06:46:01.951529 3976 catalog_manager.cc:1347] Generated new cluster ID: bf1d5c1dd86944f4997fd110655885b6
I20260807 06:46:01.951606 3976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:46:01 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:01.962560 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:01.949873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53292 (local address 127.11.137.190:40307)
0807 06:46:01.950071 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:01.950080 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:01.950117 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:46:01.950441 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:01.950450 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:01.950518 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:01.950669 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:01.951498 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:01.952854 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:01.954001 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:01.954642 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:01.954722 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:01.957818 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:01.957822 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:01.957822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:01.957835 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:01.960555 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:01.960954 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:01.960957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:01.960957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:01.961060 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:01.961297 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:01.961297 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:01.961298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:01.961615 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:01.961758 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:01.962210 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 06:46:01.962351 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
I20260807 06:46:01.963922 3976 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:46:01.964588 3976 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:46:01.972224 3976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Generated new TSK 0
I20260807 06:46:01.972412 3976 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:46:02.002095 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40307
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:02.083884 3997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:02.084134 3997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:02.084173 3997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:02.085316 3997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:02.085386 3997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:02.085428 3997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:46:02.086903 3997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:02.087180 3997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:02.087409 3997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:02.092375 4008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:02.092415 4007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:02.092558 3997 server_base.cc:1034] running on GCE node
W20260807 06:46:02.092692 4013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:02.092888 3997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:02.093082 3997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:02.094234 3997 hybrid_clock.cc:648] HybridClock initialized: now 1786085162094230 us; error 56 us; skew 500 ppm
Aug 07 06:46:02 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085162, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:02.096704 3997 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:46:02.097132 3997 webserver.cc:460] Webserver started at http://127.11.137.129:43941/ using document root <none> and password file <none>
I20260807 06:46:02.097401 3997 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:02.097450 3997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:02.097599 3997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:46:02.098605 3997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "426188b7b6ea45a79b2e1ede27fe753b"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "927748862d910889ca99bec1430dcef9"
server_key_iv: "4715684e0183e8780695c59fa2a8a1f9"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.098969 3997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "426188b7b6ea45a79b2e1ede27fe753b"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "927748862d910889ca99bec1430dcef9"
server_key_iv: "4715684e0183e8780695c59fa2a8a1f9"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.100276 3997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:46:02.100950 4022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.101115 3997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:46:02.101199 3997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "426188b7b6ea45a79b2e1ede27fe753b"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "927748862d910889ca99bec1430dcef9"
server_key_iv: "4715684e0183e8780695c59fa2a8a1f9"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.101315 3997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:02.115880 3997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:02.117728 3997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:02.117836 3997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:02.118005 3997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:02.118314 3997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:02.118347 3997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.118368 3997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:02.118415 3997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.124361 3997 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:45553
I20260807 06:46:02.124444 4186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:45553 every 8 connection(s)
I20260807 06:46:02.124758 3997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:46:02.127661 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 3997
I20260807 06:46:02.127749 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:46:02.127975 11814 external_mini_cluster.cc:1428] Setting key b85d62ac07bb22a3e0b394eb6927e4d3
Aug 07 06:46:02 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085162, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:02.135058 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.125543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:50951 (local address 127.11.137.190:40307)
0807 06:46:02.125613 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.125615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.125841 (+ 226us) server_negotiation.cc:407] Connection header received
0807 06:46:02.126338 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.126339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.126352 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.126405 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:02.127296 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.127894 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.129375 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.129575 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.129650 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.132106 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:02.132108 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:02.132108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:02.132118 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:02.133618 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.134024 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.134026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.134026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.134090 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.134357 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.134358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.134359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.134480 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:02.134573 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.134858 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.134964 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:46:02.135226 4190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.125526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:50951)
0807 06:46:02.125722 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.125758 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.126254 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.126458 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.126461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.127026 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:02.127219 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.127225 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.127988 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.127990 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.129296 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.129299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.129680 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.129681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.129835 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.130432 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:02.130443 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:02.131997 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:02.133702 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:02.133709 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:02.133712 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:02.133934 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:02.134160 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:02.134161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:02.134161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:02.134287 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:02.134567 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:02.134574 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:02.134717 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.134823 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.134983 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":114,"threads_started":1}
I20260807 06:46:02.135859 4187 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40307
I20260807 06:46:02.135972 4187 heartbeater.cc:464] Registering TS with master...
I20260807 06:46:02.136153 4187 heartbeater.cc:511] Master 127.11.137.190:40307 requested a full tablet report, sending...
I20260807 06:46:02.136765 3901 ts_manager.cc:194] Registered new tserver with Master: 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129:45553)
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:46:02.137773 3901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:50951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:46:02.156005 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40307
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:02.239542 4194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:02.239763 4194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:02.239787 4194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:02.241050 4194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:02.241092 4194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:02.241119 4194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:46:02.242658 4194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:02.242918 4194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:02.243171 4194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:02.248363 4212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:02.248361 4209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:02.248464 4210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:02.248605 4194 server_base.cc:1034] running on GCE node
I20260807 06:46:02.248879 4194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:02.249166 4194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:02.250380 4194 hybrid_clock.cc:648] HybridClock initialized: now 1786085162250357 us; error 37 us; skew 500 ppm
Aug 07 06:46:02 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085162, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:02.253197 4194 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:46:02.253718 4194 webserver.cc:460] Webserver started at http://127.11.137.130:42967/ using document root <none> and password file <none>
I20260807 06:46:02.253904 4194 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:02.253945 4194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:02.254038 4194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:46:02.255050 4194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "4b57b916966144f8885fb01223ca82d4"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "ac0d0c0c36029be61cc42b52f417a5ef"
server_key_iv: "fc6c71ed73099b93b4cf7ffea8116a26"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.255378 4194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "4b57b916966144f8885fb01223ca82d4"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "ac0d0c0c36029be61cc42b52f417a5ef"
server_key_iv: "fc6c71ed73099b93b4cf7ffea8116a26"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.256734 4194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 06:46:02.257543 4224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.257716 4194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:46:02.257817 4194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "4b57b916966144f8885fb01223ca82d4"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "ac0d0c0c36029be61cc42b52f417a5ef"
server_key_iv: "fc6c71ed73099b93b4cf7ffea8116a26"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.257880 4194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:02.274668 4194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:02.277004 4194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:02.277122 4194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:02.277396 4194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:02.277742 4194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:02.277778 4194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.277801 4194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:02.277814 4194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.283842 4194 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:45719
I20260807 06:46:02.283941 4414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:45719 every 8 connection(s)
I20260807 06:46:02.284272 4194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:46:02 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085162, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:02.291610 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 4194
I20260807 06:46:02.291745 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:46:02.291931 11814 external_mini_cluster.cc:1428] Setting key 862726261c28b1cc36ee0178de3d8fc5
I20260807 06:46:02.294109 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.285019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:57831 (local address 127.11.137.190:40307)
0807 06:46:02.285070 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.285072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.285360 (+ 288us) server_negotiation.cc:407] Connection header received
0807 06:46:02.285911 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.285912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.285924 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.285977 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:02.286966 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.287443 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.288543 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.288725 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.288813 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.291015 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:02.291016 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:02.291016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:02.291023 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:02.292534 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.293100 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.293101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.293101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.293155 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.293494 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.293494 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.293494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.293600 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:02.293653 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.293976 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.294046 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:46:02.294420 4417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.285007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:57831)
0807 06:46:02.285175 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.285260 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.285808 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.286053 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.286056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.286685 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:02.286884 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.286889 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.287546 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.287547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.288462 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.288464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.288829 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.288830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.288936 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.289569 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:02.289577 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:02.290932 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:02.292646 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:02.292653 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:02.292655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:02.293026 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:02.293271 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:02.293271 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:02.293272 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:02.293424 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:02.293667 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:02.293674 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:02.293841 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.293956 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.294138 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260807 06:46:02.295002 4415 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40307
I20260807 06:46:02.295120 4415 heartbeater.cc:464] Registering TS with master...
I20260807 06:46:02.295323 4415 heartbeater.cc:511] Master 127.11.137.190:40307 requested a full tablet report, sending...
I20260807 06:46:02.295755 3901 ts_manager.cc:194] Registered new tserver with Master: 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719)
I20260807 06:46:02.296139 3901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:57831
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:46:02.319543 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40307
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:02.403119 4422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:02.403374 4422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:02.403416 4422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:02.404726 4422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:02.404795 4422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:02.404839 4422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:46:02.406486 4422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:02.406773 4422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:02.407023 4422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:02.412123 4436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:02.412103 4431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:02.412099 4440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:02.412449 4422 server_base.cc:1034] running on GCE node
I20260807 06:46:02.412658 4422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:02.412904 4422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:02.414068 4422 hybrid_clock.cc:648] HybridClock initialized: now 1786085162414068 us; error 38 us; skew 500 ppm
Aug 07 06:46:02 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085162, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:02.416484 4422 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:46:02.416941 4422 webserver.cc:460] Webserver started at http://127.11.137.131:42063/ using document root <none> and password file <none>
I20260807 06:46:02.417182 4422 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:02.417280 4422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:02.417433 4422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:46:02.418514 4422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "edf9167424ae5c7882a5fd0fa7360427"
server_key_iv: "978bfd7f69f8ff47a982ec710d60094a"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.418883 4422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "edf9167424ae5c7882a5fd0fa7360427"
server_key_iv: "978bfd7f69f8ff47a982ec710d60094a"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.420176 4422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:46:02.420871 4454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.421042 4422 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:46:02.421141 4422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "edf9167424ae5c7882a5fd0fa7360427"
server_key_iv: "978bfd7f69f8ff47a982ec710d60094a"
server_key_version: "encryptionkey@0"
I20260807 06:46:02.421281 4422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:02.431420 4422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:02.433336 4422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:02.433497 4422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:02.433728 4422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:02.434051 4422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:02.434114 4422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.434149 4422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:02.434175 4422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:02.440200 4422 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:44517
I20260807 06:46:02.440240 4638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:44517 every 8 connection(s)
I20260807 06:46:02.440590 4422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:46:02.445266 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 4422
I20260807 06:46:02.445372 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:46:02.445603 11814 external_mini_cluster.cc:1428] Setting key c7d33c5e0e847652a88fd7258d1c2e0d
Aug 07 06:46:02 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085162, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:02.450754 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.441397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:44295 (local address 127.11.137.190:40307)
0807 06:46:02.441477 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.441480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.441701 (+ 221us) server_negotiation.cc:407] Connection header received
0807 06:46:02.442195 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.442197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.442209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.442261 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:02.443225 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.443719 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.444899 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.445162 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.445273 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.447786 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:02.447787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:02.447788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:02.447795 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:02.449358 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.449840 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.449841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.449842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.449914 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.450218 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.450219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.450219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.450329 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:02.450386 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.450625 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.450691 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:46:02.450937 4642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.441380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:44295)
0807 06:46:02.441574 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.441612 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.442108 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.442324 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.442328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.442924 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:02.443148 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.443153 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.443810 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.443811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.444781 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.444784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.445281 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.445282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.445439 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.446039 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:02.446050 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:02.447695 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:02.449454 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:02.449461 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:02.449463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:02.449773 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:02.449984 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:02.449985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:02.449985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:02.450149 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:02.450390 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:02.450396 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:02.450512 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.450598 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.450720 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":103,"threads_started":1}
I20260807 06:46:02.451479 4639 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40307
I20260807 06:46:02.451586 4639 heartbeater.cc:464] Registering TS with master...
I20260807 06:46:02.451797 4639 heartbeater.cc:511] Master 127.11.137.190:40307 requested a full tablet report, sending...
I20260807 06:46:02.452208 3901 ts_manager.cc:194] Registered new tserver with Master: 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
I20260807 06:46:02.452594 3901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:44295
I20260807 06:46:02.457531 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:46:02.464668 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.458881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53302 (local address 127.11.137.190:40307)
0807 06:46:02.458939 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.458941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.459066 (+ 125us) server_negotiation.cc:407] Connection header received
0807 06:46:02.459120 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.459121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.459129 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.459183 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:02.459717 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.460166 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.460984 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.461162 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.461269 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.462394 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:02.462395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:02.462396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:02.462402 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:02.463781 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.464071 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.464072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.464072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.464122 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:02.464268 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:02.464268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:02.464269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:02.464393 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:02.464465 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.464547 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.464605 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:46:02.466442 3901 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:46:02.468029 3901 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:46:02.474426 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.470283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45719 (local address 127.0.0.1:40516)
0807 06:46:02.470671 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.470681 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.470745 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.471031 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.471032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.471034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:02.471100 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.471102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.472445 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.472446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.473456 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.473457 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.474095 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.474096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.474187 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.474207 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.474289 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.474353 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":55,"threads_started":1}
I20260807 06:46:02.474443 4662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.470474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40516 (local address 127.11.137.130:45719)
0807 06:46:02.470643 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.470647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.470752 (+ 105us) server_negotiation.cc:407] Connection header received
0807 06:46:02.470838 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.470841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.470858 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.470937 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:02.471170 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.472334 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.473539 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.474006 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.474096 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.474151 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.474306 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.474354 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260807 06:46:02.474457 4659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.470344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40982 (local address 127.11.137.131:44517)
0807 06:46:02.470533 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.470538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.470740 (+ 202us) server_negotiation.cc:407] Connection header received
0807 06:46:02.470789 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.470792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.470809 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.470883 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:02.471119 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.471920 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.473291 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.474013 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.474077 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.474132 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.474339 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.474378 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":91,"threads_started":1}
I20260807 06:46:02.474936 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.470708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.11.137.129:45553)
0807 06:46:02.471254 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.471259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.471269 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:46:02.471306 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.471308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.471323 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.471402 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:02.471529 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.472558 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.473915 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.474628 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.474689 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.474720 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.474850 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.474878 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":86,"threads_started":1}
I20260807 06:46:02.474956 4660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.470482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:45553 (local address 127.0.0.1:42934)
0807 06:46:02.470885 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.470896 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.470939 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.471420 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.471421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.471423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:02.471459 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.471460 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.472698 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.472699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.473811 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.473814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.474712 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.474713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.474776 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.474780 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.474842 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.474879 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":53,"threads_started":1}
I20260807 06:46:02.475122 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.470253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44517 (local address 127.0.0.1:40982)
0807 06:46:02.470529 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.470575 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.470650 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.470975 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.470978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.470980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:02.471043 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.471045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.472023 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.472024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.473180 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.473183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.474167 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.474168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.474245 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.474249 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.474297 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.475056 (+ 759us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":707,"thread_start_us":63,"threads_started":1}
I20260807 06:46:02.475764 4307 tablet_service.cc:1467] Processing CreateTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 (DEFAULT_TABLE table=test-table [id=5d7b12ed48c64faa9434504dd7456490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:46:02.475973 4532 tablet_service.cc:1467] Processing CreateTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 (DEFAULT_TABLE table=test-table [id=5d7b12ed48c64faa9434504dd7456490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:46:02.476128 4307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 005bdcf7c00b4d44a9d1593266bde326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:02.476318 4532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 005bdcf7c00b4d44a9d1593266bde326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:02.477809 4092 tablet_service.cc:1467] Processing CreateTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 (DEFAULT_TABLE table=test-table [id=5d7b12ed48c64faa9434504dd7456490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:46:02.478147 4092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 005bdcf7c00b4d44a9d1593266bde326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:02.479050 4670 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Bootstrap starting.
I20260807 06:46:02.479418 4671 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Bootstrap starting.
I20260807 06:46:02.479892 4670 tablet_bootstrap.cc:654] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:02.480082 4671 tablet_bootstrap.cc:654] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:02.480530 4670 log.cc:824] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:02.480691 4671 log.cc:824] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:02.481266 4674 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap starting.
I20260807 06:46:02.481532 4671 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: No bootstrap required, opened a new log
I20260807 06:46:02.481612 4671 ts_tablet_manager.cc:1397] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:46:02.481976 4670 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: No bootstrap required, opened a new log
I20260807 06:46:02.482057 4670 ts_tablet_manager.cc:1397] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:46:02.482105 4674 tablet_bootstrap.cc:654] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:02.482751 4674 log.cc:824] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:02.483358 4671 raft_consensus.cc:348] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.483520 4671 raft_consensus.cc:374] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:02.483542 4674 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: No bootstrap required, opened a new log
I20260807 06:46:02.483563 4671 raft_consensus.cc:729] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb12eb29cea47ca8655ea5c915e1c92, State: Initialized, Role: FOLLOWER
I20260807 06:46:02.483597 4674 ts_tablet_manager.cc:1397] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:46:02.483714 4671 consensus_queue.cc:260] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.484018 4639 heartbeater.cc:503] Master 127.11.137.190:40307 was elected leader, sending a full tablet report...
I20260807 06:46:02.484035 4671 ts_tablet_manager.cc:1428] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:46:02.484158 4670 raft_consensus.cc:348] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.484372 4670 raft_consensus.cc:374] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:02.484418 4670 raft_consensus.cc:729] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b57b916966144f8885fb01223ca82d4, State: Initialized, Role: FOLLOWER
I20260807 06:46:02.484526 4670 consensus_queue.cc:260] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.484781 4670 ts_tablet_manager.cc:1428] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:46:02.484822 4415 heartbeater.cc:503] Master 127.11.137.190:40307 was elected leader, sending a full tablet report...
I20260807 06:46:02.485976 4674 raft_consensus.cc:348] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.486115 4674 raft_consensus.cc:374] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:02.486137 4674 raft_consensus.cc:729] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426188b7b6ea45a79b2e1ede27fe753b, State: Initialized, Role: FOLLOWER
I20260807 06:46:02.486284 4674 consensus_queue.cc:260] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.486541 4674 ts_tablet_manager.cc:1428] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:46:02.486586 4187 heartbeater.cc:503] Master 127.11.137.190:40307 was elected leader, sending a full tablet report...
W20260807 06:46:02.534930 4416 tablet.cc:2369] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:46:02.625439 4189 tablet.cc:2369] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:46:02.681327 4680 raft_consensus.cc:482] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:46:02.681475 4680 raft_consensus.cc:504] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.681949 4680 leader_election.cc:288] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517), 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719)
I20260807 06:46:02.685063 4662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.682245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:51575 (local address 127.11.137.130:45719)
0807 06:46:02.682310 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.682312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.682481 (+ 169us) server_negotiation.cc:407] Connection header received
0807 06:46:02.682520 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.682521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.682533 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.682611 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:02.682822 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.683278 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.684317 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.684696 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.684782 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.684791 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.684951 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.684987 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 06:46:02.685061 4659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.682268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:58541 (local address 127.11.137.131:44517)
0807 06:46:02.682316 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.682317 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.682448 (+ 131us) server_negotiation.cc:407] Connection header received
0807 06:46:02.682515 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.682517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.682526 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.682582 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:02.682771 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.683277 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.684316 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.684697 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.684788 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.684796 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.684951 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.684987 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:46:02.685086 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.682162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45719 (local address 127.11.137.129:51575)
0807 06:46:02.682375 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.682385 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.682468 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.682639 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.682640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.682642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:02.682723 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.682725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.683382 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.683383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.684217 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.684219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.684792 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.684793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.684869 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.684872 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.684945 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.684986 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
I20260807 06:46:02.685088 4681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.682157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44517 (local address 127.11.137.129:58541)
0807 06:46:02.682361 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.682379 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:02.682436 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:02.682602 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:02.682603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:02.682605 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:02.682696 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.682698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.683368 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.683369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.684219 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:02.684221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.684790 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.684791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:02.684869 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.684873 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:46:02.684943 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 06:46:02.684988 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":48,"thread_start_us":121,"threads_started":1}
I20260807 06:46:02.685447 4338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005bdcf7c00b4d44a9d1593266bde326" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b57b916966144f8885fb01223ca82d4" is_pre_election: true
I20260807 06:46:02.685665 4338 raft_consensus.cc:2454] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 0.
I20260807 06:46:02.685961 4027 leader_election.cc:302] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b, 4b57b916966144f8885fb01223ca82d4; no voters:
I20260807 06:46:02.685998 4566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005bdcf7c00b4d44a9d1593266bde326" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" is_pre_election: true
I20260807 06:46:02.686149 4566 raft_consensus.cc:2454] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 0.
I20260807 06:46:02.686280 4680 raft_consensus.cc:2781] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:46:02.686362 4680 raft_consensus.cc:482] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:46:02.686399 4680 raft_consensus.cc:3037] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:02.687152 4680 raft_consensus.cc:504] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.687315 4680 leader_election.cc:288] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 election: Requested vote from peers 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517), 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719)
I20260807 06:46:02.687469 4566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005bdcf7c00b4d44a9d1593266bde326" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
I20260807 06:46:02.687557 4566 raft_consensus.cc:3037] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:02.687546 4338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005bdcf7c00b4d44a9d1593266bde326" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b57b916966144f8885fb01223ca82d4"
I20260807 06:46:02.687634 4338 raft_consensus.cc:3037] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:02.688325 4566 raft_consensus.cc:2454] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 1.
I20260807 06:46:02.688347 4338 raft_consensus.cc:2454] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 1.
I20260807 06:46:02.688513 4023 leader_election.cc:302] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b, 8cb12eb29cea47ca8655ea5c915e1c92; no voters:
I20260807 06:46:02.688621 4680 raft_consensus.cc:2781] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:46:02.688819 4680 raft_consensus.cc:686] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 LEADER]: Becoming Leader. State: Replica: 426188b7b6ea45a79b2e1ede27fe753b, State: Running, Role: LEADER
I20260807 06:46:02.688941 4680 consensus_queue.cc:237] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:02.689850 3898 catalog_manager.cc:5495] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b reported cstate change: term changed from 0 to 1, leader changed from <none> to 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129). New cstate: current_term: 1 leader_uuid: "426188b7b6ea45a79b2e1ede27fe753b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } health_report { overall_health: HEALTHY } } }
W20260807 06:46:02.691147 4640 tablet.cc:2369] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:46:02.699007 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.696946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.11.137.129:45553)
0807 06:46:02.697010 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:02.697012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:02.697022 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:46:02.697051 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:02.697051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:02.697069 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:02.697131 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:46:02.697294 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.697720 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.698402 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:02.698580 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:02.698629 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:02.698765 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:46:02.698853 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:46:02.698912 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:02.698945 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 06:46:02.698961 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 06:46:02.700881 4338 raft_consensus.cc:1261] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Refusing update from remote peer 426188b7b6ea45a79b2e1ede27fe753b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:46:02.700907 4566 raft_consensus.cc:1261] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Refusing update from remote peer 426188b7b6ea45a79b2e1ede27fe753b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:46:02.701263 4684 consensus_queue.cc:1035] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:46:02.701393 4680 consensus_queue.cc:1035] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:46:02.704190 4695 mvcc.cc:205] Tried to move back new op lower bound from 7315804826420113408 to 7315804826374750208. Current Snapshot: MvccSnapshot[applied={T|T < 7315804826420113408 or (T in {7315804826420113408})}]
I20260807 06:46:02.704926 4693 mvcc.cc:205] Tried to move back new op lower bound from 7315804826420113408 to 7315804826374750208. Current Snapshot: MvccSnapshot[applied={T|T < 7315804826420113408 or (T in {7315804826420113408})}]
I20260807 06:46:02.706456 3898 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:46:02.706549 3898 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:46:02.707314 3898 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Sending DeleteTablet for 3 replicas of tablet 005bdcf7c00b4d44a9d1593266bde326
I20260807 06:46:02.707624 4532 tablet_service.cc:1514] Processing DeleteTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:02 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:40982
I20260807 06:46:02.707729 4092 tablet_service.cc:1514] Processing DeleteTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:02 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:42934
I20260807 06:46:02.707858 4705 tablet_replica.cc:330] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: stopping tablet replica
I20260807 06:46:02.707943 4709 tablet_replica.cc:330] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: stopping tablet replica
I20260807 06:46:02.707984 4705 raft_consensus.cc:2229] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:46:02.708037 4709 raft_consensus.cc:2229] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:46:02.708020 4307 tablet_service.cc:1514] Processing DeleteTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:02 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:40516
I20260807 06:46:02.708081 4705 raft_consensus.cc:2258] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:46:02.708127 4709 raft_consensus.cc:2258] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:46:02.708341 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 3997
I20260807 06:46:02.708539 4709 ts_tablet_manager.cc:1905] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:46:02.717896 4705 ts_tablet_manager.cc:1905] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:46:02.721076 4710 tablet_replica.cc:330] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: stopping tablet replica
I20260807 06:46:02.721063 4705 ts_tablet_manager.cc:1918] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:46:02.721154 4705 log.cc:1196] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/005bdcf7c00b4d44a9d1593266bde326
I20260807 06:46:02.721282 4710 raft_consensus.cc:2229] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:46:02.721459 4710 raft_consensus.cc:2258] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:46:02.721509 4705 ts_tablet_manager.cc:1939] T 005bdcf7c00b4d44a9d1593266bde326 P 8cb12eb29cea47ca8655ea5c915e1c92: Deleting consensus metadata
I20260807 06:46:02.721968 4710 ts_tablet_manager.cc:1905] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:46:02.722078 3876 catalog_manager.cc:4841] TS 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517): tablet 005bdcf7c00b4d44a9d1593266bde326 (table test-table [id=5d7b12ed48c64faa9434504dd7456490]) successfully deleted
I20260807 06:46:02.724062 4710 ts_tablet_manager.cc:1918] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:46:02.724149 4710 log.cc:1196] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/005bdcf7c00b4d44a9d1593266bde326
I20260807 06:46:02.724433 4710 ts_tablet_manager.cc:1939] T 005bdcf7c00b4d44a9d1593266bde326 P 4b57b916966144f8885fb01223ca82d4: Deleting consensus metadata
I20260807 06:46:02.724880 3879 catalog_manager.cc:4841] TS 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719): tablet 005bdcf7c00b4d44a9d1593266bde326 (table test-table [id=5d7b12ed48c64faa9434504dd7456490]) successfully deleted
W20260807 06:46:02.726456 3879 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:45553 (error 108)
I20260807 06:46:02.726694 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 4194
I20260807 06:46:02.726974 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:02.726847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:45553 (local address 127.0.0.1:42958)
0807 06:46:02.726894 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:02.726934 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:45553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260807 06:46:02.729982 3879 catalog_manager.cc:4584] TS 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129:45553): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 005bdcf7c00b4d44a9d1593266bde326: Network error: Client connection negotiation failed: client connection to 127.11.137.129:45553: connect: Connection refused (error 111)
I20260807 06:46:02.740481 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 4422
I20260807 06:46:02.752648 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 3849
I20260807 06:46:22.767234 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40307
--webserver_interface=127.11.137.190
--webserver_port=34613
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:40307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:22.852382 4714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:22.852578 4714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:22.852600 4714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:22.853753 4714 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:46:22.853794 4714 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:46:22.853807 4714 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:46:22.853818 4714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:46:22.853832 4714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:22.853843 4714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:22.853855 4714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:46:22.853873 4714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:46:22.855281 4714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:40307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=34613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:22.855473 4714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:22.855631 4714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:22.865196 4727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:22.865252 4726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:22.865258 4730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:22.865343 4714 server_base.cc:1034] running on GCE node
I20260807 06:46:22.865783 4714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:22.866142 4714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:22.867321 4714 hybrid_clock.cc:648] HybridClock initialized: now 1786085182867293 us; error 40 us; skew 500 ppm
Aug 07 06:46:22 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085182, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:22.875661 4714 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:46:22.876194 4714 webserver.cc:460] Webserver started at http://127.11.137.190:34613/ using document root <none> and password file <none>
I20260807 06:46:22.876459 4714 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:22.876579 4714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:22.878168 4714 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:46:22.878901 4744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:22.879132 4714 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:46:22.879251 4714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "e2851a0f41fc41b0a6898c9c293c9dc4"
format_stamp: "Formatted at 2026-08-07 06:46:01 on dist-test-slave-8hhm"
server_key: "aacaceada58b528d18136f010d0f4e06"
server_key_iv: "03f31aa21dca5204bcbb73c790dce017"
server_key_version: "encryptionkey@0"
I20260807 06:46:22.879662 4714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:22.890375 4714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:22.895424 4714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:22.895603 4714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:22.900781 4714 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:40307
I20260807 06:46:22.900815 4831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:40307 every 8 connection(s)
I20260807 06:46:22.901263 4714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:46:22.903390 4832 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:46:22.904011 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 4714
I20260807 06:46:22.904356 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:45553
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:40307
--webserver_port=43941
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:46:22.904372 4832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap starting.
I20260807 06:46:22.924463 4832 log.cc:824] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:22.926821 4832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:46:22.927177 4832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap complete.
I20260807 06:46:22.929661 4832 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:22.929940 4832 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2851a0f41fc41b0a6898c9c293c9dc4, State: Initialized, Role: FOLLOWER
I20260807 06:46:22.930178 4832 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:22.930284 4832 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:46:22.930346 4832 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:46:22.930395 4832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:46:22.931416 4832 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:22.931542 4832 leader_election.cc:302] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2851a0f41fc41b0a6898c9c293c9dc4; no voters:
I20260807 06:46:22.931753 4832 leader_election.cc:288] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:46:22.931793 4839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:46:22.931912 4839 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 LEADER]: Becoming Leader. State: Replica: e2851a0f41fc41b0a6898c9c293c9dc4, State: Running, Role: LEADER
I20260807 06:46:22.932035 4832 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:46:22.932082 4839 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:22.932471 4840 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } } }
I20260807 06:46:22.932576 4840 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 06:46:22.932807 4842 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2851a0f41fc41b0a6898c9c293c9dc4. Latest consensus state: current_term: 2 leader_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } } }
I20260807 06:46:22.932894 4842 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 06:46:22.933002 4847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:46:22.933900 4847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:46:22.934197 4847 catalog_manager.cc:1259] Loaded cluster ID: bf1d5c1dd86944f4997fd110655885b6
I20260807 06:46:22.934275 4847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:46:22.935362 4847 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:46:22.935573 4847 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Loaded TSK: 0
I20260807 06:46:22.950809 4847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Generated new TSK 1
I20260807 06:46:22.950907 4847 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:46:23.000612 4836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:23.000840 4836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:23.000880 4836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:23.002089 4836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:23.002156 4836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:23.002206 4836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:46:23.003620 4836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:45553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=43941
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:23.003903 4836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:23.004146 4836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:23.010290 4876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:23.010299 4872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:23.010306 4873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:23.010667 4836 server_base.cc:1034] running on GCE node
I20260807 06:46:23.010892 4836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:23.011178 4836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:23.012370 4836 hybrid_clock.cc:648] HybridClock initialized: now 1786085183012355 us; error 25 us; skew 500 ppm
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085183, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:23.015431 4836 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:46:23.015905 4836 webserver.cc:460] Webserver started at http://127.11.137.129:43941/ using document root <none> and password file <none>
I20260807 06:46:23.016129 4836 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:23.016222 4836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:23.017788 4836 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:46:23.018642 4892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.018815 4836 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:46:23.018958 4836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "426188b7b6ea45a79b2e1ede27fe753b"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "927748862d910889ca99bec1430dcef9"
server_key_iv: "4715684e0183e8780695c59fa2a8a1f9"
server_key_version: "encryptionkey@0"
I20260807 06:46:23.019347 4836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:23.056320 4836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:23.059140 4836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:23.059322 4836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:23.059609 4836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:23.060133 4903 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:46:23.062126 4836 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:46:23.062196 4836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 06:46:23.062245 4836 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:46:23.062920 4836 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:46:23.062979 4836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 06:46:23.063038 4903 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap starting.
I20260807 06:46:23.064880 4903 log.cc:824] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:23.067989 4903 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:46:23.068295 4903 tablet_bootstrap.cc:492] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap complete.
I20260807 06:46:23.068477 4903 ts_tablet_manager.cc:1397] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:46:23.070310 4903 raft_consensus.cc:348] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.070658 4836 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:45553
I20260807 06:46:23.070665 4903 raft_consensus.cc:729] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426188b7b6ea45a79b2e1ede27fe753b, State: Initialized, Role: FOLLOWER
I20260807 06:46:23.070928 4903 consensus_queue.cc:260] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.071121 4836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:46:23.071236 4903 ts_tablet_manager.cc:1428] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:46:23.071530 5074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:45553 every 8 connection(s)
I20260807 06:46:23.077775 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 4836
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085183, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:23.078094 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:45719
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:40307
--webserver_port=42967
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:46:23.082195 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.071966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:60845 (local address 127.11.137.190:40307)
0807 06:46:23.072396 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.072403 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.072428 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:46:23.072527 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.072531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.072566 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.072698 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:23.073371 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.074234 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.075250 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.075636 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.075757 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.078611 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:23.078615 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:23.078615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:23.078625 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:23.080363 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.080811 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.080813 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.080814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.080949 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.081282 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.081283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.081283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.081510 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:23.081591 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.081940 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.082050 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":82,"threads_started":1}
I20260807 06:46:23.082334 5082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.071879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:60845)
0807 06:46:23.072035 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.072077 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.072236 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.072737 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.072741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.073017 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:23.073198 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.073202 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.074373 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.074375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.075140 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.075142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.075731 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.075733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.075862 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.076344 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:23.076351 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:23.078501 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:23.080456 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.080464 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.080466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.080694 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.081031 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.081032 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.081032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.081183 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.081583 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:23.081590 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:23.081766 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.081872 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.082053 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260807 06:46:23.083280 5080 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40307
I20260807 06:46:23.083375 5080 heartbeater.cc:464] Registering TS with master...
I20260807 06:46:23.083582 5080 heartbeater.cc:511] Master 127.11.137.190:40307 requested a full tablet report, sending...
I20260807 06:46:23.084329 4766 ts_manager.cc:194] Registered new tserver with Master: 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129:45553)
I20260807 06:46:23.085435 4766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:60845
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085182, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.129@KRBTEST.COM
I20260807 06:46:23.093464 5092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.084900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:45553 (local address 127.0.0.1:42380)
0807 06:46:23.085145 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.085181 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.085270 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.085536 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.085543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.085918 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:23.085981 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.085984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.086902 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.086903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.087912 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.087915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.088355 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.088356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.088450 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.088886 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:23.088892 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:23.090400 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:23.092228 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.092235 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.092237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.092441 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.092682 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.092683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.092683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.092749 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.093066 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:23.093074 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:23.093126 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.093247 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.093368 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":86,"threads_started":1}
I20260807 06:46:23.093477 5094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.084959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42380 (local address 127.11.137.129:45553)
0807 06:46:23.085385 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.085389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.085397 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:46:23.085428 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.085430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.085442 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.085513 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:23.086072 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.086813 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.087998 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.088277 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.088331 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.090490 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:23.090498 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:23.090499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:23.090506 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:23.092120 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.092533 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.092536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.092536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.092600 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.092819 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.092820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.092821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.092992 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:23.093097 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.093285 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.093370 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":81,"threads_started":1}
I20260807 06:46:23.093909 4979 tablet_service.cc:1514] Processing DeleteTablet for tablet 005bdcf7c00b4d44a9d1593266bde326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:02 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:42380
I20260807 06:46:23.094578 5095 tablet_replica.cc:330] stopping tablet replica
I20260807 06:46:23.094710 5095 raft_consensus.cc:2229] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:46:23.094805 5095 raft_consensus.cc:2258] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:46:23.095098 5095 ts_tablet_manager.cc:1905] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:46:23.097489 5095 ts_tablet_manager.cc:1918] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:46:23.097613 5095 log.cc:1196] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal/wals/005bdcf7c00b4d44a9d1593266bde326
I20260807 06:46:23.097847 5095 ts_tablet_manager.cc:1939] T 005bdcf7c00b4d44a9d1593266bde326 P 426188b7b6ea45a79b2e1ede27fe753b: Deleting consensus metadata
I20260807 06:46:23.098361 4750 catalog_manager.cc:4841] TS 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129:45553): tablet 005bdcf7c00b4d44a9d1593266bde326 (table test-table [id=5d7b12ed48c64faa9434504dd7456490]) successfully deleted
W20260807 06:46:23.165761 5090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:23.166028 5090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:23.166056 5090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:23.167207 5090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:23.167248 5090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:23.167274 5090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:46:23.168658 5090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:45719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=42967
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:23.168859 5090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:23.169032 5090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:23.174446 5103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:23.174446 5107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:23.174556 5090 server_base.cc:1034] running on GCE node
W20260807 06:46:23.174477 5110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:23.174889 5090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:23.175153 5090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:23.176323 5090 hybrid_clock.cc:648] HybridClock initialized: now 1786085183176310 us; error 28 us; skew 500 ppm
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085183, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:23.178906 5090 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:46:23.179338 5090 webserver.cc:460] Webserver started at http://127.11.137.130:42967/ using document root <none> and password file <none>
I20260807 06:46:23.179589 5090 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:23.179680 5090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:23.181043 5090 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:46:23.181710 5121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.181881 5090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.181985 5090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "4b57b916966144f8885fb01223ca82d4"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "ac0d0c0c36029be61cc42b52f417a5ef"
server_key_iv: "fc6c71ed73099b93b4cf7ffea8116a26"
server_key_version: "encryptionkey@0"
I20260807 06:46:23.182355 5090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:23.198158 5090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:23.200213 5090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:23.200387 5090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:23.200632 5090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:23.200966 5090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:23.201022 5090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.201061 5090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:23.201089 5090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.207419 5090 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:45719
I20260807 06:46:23.207465 5304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:45719 every 8 connection(s)
I20260807 06:46:23.207847 5090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085183, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:23.214715 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 5090
I20260807 06:46:23.215009 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:44517
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:40307
--webserver_port=42063
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:46:23.217334 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.208600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:43723 (local address 127.11.137.190:40307)
0807 06:46:23.208681 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.208683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.208962 (+ 279us) server_negotiation.cc:407] Connection header received
0807 06:46:23.209516 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.209517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.209528 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.209596 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:23.210511 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.211001 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.211966 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.212166 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.212218 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.214284 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:23.214285 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:23.214285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:23.214293 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:23.215784 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.216279 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.216280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.216280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.216336 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.216635 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.216635 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.216636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.216745 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:23.216828 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.217112 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.217203 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:46:23.217511 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.208616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:43723)
0807 06:46:23.208826 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.208863 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.209425 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.209650 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.209653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.210230 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:23.210426 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.210431 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.211083 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.211084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.211884 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.211886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.212244 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.212244 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.212350 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.212807 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:23.212816 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:23.214201 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:23.215867 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.215875 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.215877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.216191 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.216407 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.216407 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.216408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.216568 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.216824 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:23.216833 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:23.216970 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.217086 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.217272 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260807 06:46:23.218240 5305 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40307
I20260807 06:46:23.218360 5305 heartbeater.cc:464] Registering TS with master...
I20260807 06:46:23.218547 5305 heartbeater.cc:511] Master 127.11.137.190:40307 requested a full tablet report, sending...
I20260807 06:46:23.218976 4766 ts_manager.cc:194] Registered new tserver with Master: 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719)
I20260807 06:46:23.219364 4766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:43723
W20260807 06:46:23.301530 5309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:23.301774 5309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:23.301816 5309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:23.302986 5309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:23.303054 5309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:23.303099 5309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:46:23.304589 5309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:44517
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=42063
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:23.304872 5309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:23.305107 5309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:23.310429 5321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:23.310439 5328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:23.310663 5309 server_base.cc:1034] running on GCE node
W20260807 06:46:23.310439 5320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:23.310993 5309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:23.311281 5309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:23.312462 5309 hybrid_clock.cc:648] HybridClock initialized: now 1786085183312444 us; error 49 us; skew 500 ppm
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085183, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:23.315090 5309 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:46:23.315541 5309 webserver.cc:460] Webserver started at http://127.11.137.131:42063/ using document root <none> and password file <none>
I20260807 06:46:23.315779 5309 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:23.315871 5309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:23.317322 5309 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 06:46:23.317939 5338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.318111 5309 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:46:23.318217 5309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "edf9167424ae5c7882a5fd0fa7360427"
server_key_iv: "978bfd7f69f8ff47a982ec710d60094a"
server_key_version: "encryptionkey@0"
I20260807 06:46:23.318594 5309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:23.330546 5309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:23.332680 5309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:23.332845 5309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:23.333187 5309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:23.333585 5309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:23.333643 5309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.333680 5309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:23.333707 5309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:23.339802 5309 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:44517
I20260807 06:46:23.339854 5531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:44517 every 8 connection(s)
I20260807 06:46:23.340201 5309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:46:23.341667 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 5309
Aug 07 06:46:23 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085183, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:46:23.349805 5541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.342099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48350 (local address 127.11.137.190:40307)
0807 06:46:23.342416 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.342417 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.342423 (+ 6us) server_negotiation.cc:407] Connection header received
0807 06:46:23.342439 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.342439 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.342447 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.342495 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:23.343253 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.343924 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.345026 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.345302 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.345373 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.346834 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:23.346835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:23.346835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:23.346841 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:23.348474 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.348896 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.348897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.348898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.348965 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.349187 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.349188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.349188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.349380 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:23.349565 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.349613 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.349690 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":93,"threads_started":1}
I20260807 06:46:23.351491 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.340903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:33383 (local address 127.11.137.190:40307)
0807 06:46:23.340974 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.340976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.341176 (+ 200us) server_negotiation.cc:407] Connection header received
0807 06:46:23.341747 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.341748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.341763 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.341822 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:23.343117 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.343897 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.345333 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.345540 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.345593 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.348260 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:23.348262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:23.348262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:23.348269 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:23.350017 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.350494 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.350494 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.350495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.350579 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.350836 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.350837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.350838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.350950 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:23.351019 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.351328 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.351406 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:46:23.351689 5536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.340856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:33383)
0807 06:46:23.341035 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.341077 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.341630 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.341895 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.341900 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.342713 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:23.343016 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.343024 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.344012 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.344013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.345192 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.345194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.345629 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.345630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.345753 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.346202 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:23.346212 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:23.348164 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:23.350151 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.350157 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.350159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.350421 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.350638 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:23.350639 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:23.350639 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:23.350762 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:23.351024 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:23.351031 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:23.351185 (+ 154us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.351292 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.351455 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260807 06:46:23.352190 5532 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40307
I20260807 06:46:23.352301 5532 heartbeater.cc:464] Registering TS with master...
I20260807 06:46:23.352481 5532 heartbeater.cc:511] Master 127.11.137.190:40307 requested a full tablet report, sending...
I20260807 06:46:23.352869 4766 ts_manager.cc:194] Registered new tserver with Master: 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
I20260807 06:46:23.353308 4766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:33383
I20260807 06:46:23.361539 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:46:23.364097 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.361907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48366 (local address 127.11.137.190:40307)
0807 06:46:23.361969 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.361971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.362082 (+ 111us) server_negotiation.cc:407] Connection header received
0807 06:46:23.362133 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.362134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.362167 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.362227 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:46:23.362342 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.362810 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.363518 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.363700 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.363749 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.363883 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:46:23.363927 (+ 44us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 06:46:23.364048 (+ 121us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48366: token expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 06:46:23.364144 5089 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48366: token expired
W20260807 06:46:23.364431 4646 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.137.190:40307)
I20260807 06:46:23.370288 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.364682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48368 (local address 127.11.137.190:40307)
0807 06:46:23.364717 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.364718 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.364728 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:46:23.364800 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.364801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.364807 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.364853 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:23.365418 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.365843 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.366548 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.366718 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.366766 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.367927 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:23.367928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:23.367929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:23.367934 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:23.369426 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.369720 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.369721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.369721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.369776 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:23.369939 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:23.369939 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:23.369940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:23.370030 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:23.370108 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.370181 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.370232 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 06:46:23.371447 4766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:46:23.373129 4766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:46:23.375566 4979 tablet_service.cc:1467] Processing CreateTablet for tablet acf18d6183d4468fb01677adee491db7 (DEFAULT_TABLE table=test-table [id=7b6b41eecf914381957759b19a93bfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:46:23.375787 4979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf18d6183d4468fb01677adee491db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:23.377424 4903 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap starting.
I20260807 06:46:23.377921 4903 tablet_bootstrap.cc:654] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:23.378558 4903 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: No bootstrap required, opened a new log
I20260807 06:46:23.378631 4903 ts_tablet_manager.cc:1397] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:46:23.378804 4903 raft_consensus.cc:348] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.378888 4903 raft_consensus.cc:374] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:23.378940 4903 raft_consensus.cc:729] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426188b7b6ea45a79b2e1ede27fe753b, State: Initialized, Role: FOLLOWER
I20260807 06:46:23.378997 4903 consensus_queue.cc:260] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.379097 4903 ts_tablet_manager.cc:1428] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 06:46:23.379104 5092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.375100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45719 (local address 127.0.0.1:43916)
0807 06:46:23.375225 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.375236 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.375272 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.375606 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.375607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.375609 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:23.375653 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.375655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.376891 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.376891 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.377900 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.377902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.378816 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.378818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.378892 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.378917 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.378978 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.379025 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260807 06:46:23.379304 5080 heartbeater.cc:503] Master 127.11.137.190:40307 was elected leader, sending a full tablet report...
I20260807 06:46:23.379410 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.375223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43916 (local address 127.11.137.130:45719)
0807 06:46:23.375393 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.375398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.375410 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:46:23.375463 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.375465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.375482 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.375566 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:23.375754 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.376802 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.377989 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.378725 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.378797 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.378849 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.379274 (+ 425us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.379324 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
I20260807 06:46:23.380110 5196 tablet_service.cc:1467] Processing CreateTablet for tablet acf18d6183d4468fb01677adee491db7 (DEFAULT_TABLE table=test-table [id=7b6b41eecf914381957759b19a93bfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:46:23.380476 5196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf18d6183d4468fb01677adee491db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:23.381472 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.375132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44517 (local address 127.0.0.1:53814)
0807 06:46:23.375412 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.375423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.375475 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.377768 (+ 2293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.377769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.377771 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:23.377806 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.377867 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.379280 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.379281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.380350 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.380353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.381300 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.381301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.381357 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.381360 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.381397 (+ 37us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.381426 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":112,"threads_started":1}
I20260807 06:46:23.381556 5550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.375250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53814 (local address 127.11.137.131:44517)
0807 06:46:23.377582 (+ 2332us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.377587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.377600 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:46:23.377648 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.377650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.377668 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.377757 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:23.378049 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.379092 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.380456 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.381168 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.381272 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.381327 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.381432 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.381471 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2286,"thread_start_us":99,"threads_started":1}
I20260807 06:46:23.382223 5422 tablet_service.cc:1467] Processing CreateTablet for tablet acf18d6183d4468fb01677adee491db7 (DEFAULT_TABLE table=test-table [id=7b6b41eecf914381957759b19a93bfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:46:23.382534 5422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf18d6183d4468fb01677adee491db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:46:23.383719 5552 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Bootstrap starting.
I20260807 06:46:23.384263 5552 tablet_bootstrap.cc:654] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:23.384739 5552 log.cc:824] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:23.385527 5552 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: No bootstrap required, opened a new log
I20260807 06:46:23.385582 5552 ts_tablet_manager.cc:1397] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:46:23.385949 5555 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Bootstrap starting.
I20260807 06:46:23.386615 5555 tablet_bootstrap.cc:654] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Neither blocks nor log segments found. Creating new log.
I20260807 06:46:23.387234 5555 log.cc:824] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:23.388059 5555 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: No bootstrap required, opened a new log
I20260807 06:46:23.388130 5555 ts_tablet_manager.cc:1397] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:46:23.387992 5552 raft_consensus.cc:348] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.388183 5552 raft_consensus.cc:374] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:23.388237 5552 raft_consensus.cc:729] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b57b916966144f8885fb01223ca82d4, State: Initialized, Role: FOLLOWER
I20260807 06:46:23.388366 5552 consensus_queue.cc:260] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.388650 5552 ts_tablet_manager.cc:1428] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:46:23.388669 5305 heartbeater.cc:503] Master 127.11.137.190:40307 was elected leader, sending a full tablet report...
I20260807 06:46:23.389999 5555 raft_consensus.cc:348] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.390129 5555 raft_consensus.cc:374] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:46:23.390151 5555 raft_consensus.cc:729] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb12eb29cea47ca8655ea5c915e1c92, State: Initialized, Role: FOLLOWER
I20260807 06:46:23.390290 5555 consensus_queue.cc:260] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.390555 5555 ts_tablet_manager.cc:1428] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:46:23.390583 5532 heartbeater.cc:503] Master 127.11.137.190:40307 was elected leader, sending a full tablet report...
W20260807 06:46:23.458482 5306 tablet.cc:2369] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:46:23.522380 5078 raft_consensus.cc:482] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:46:23.522580 5078 raft_consensus.cc:504] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.523021 5078 leader_election.cc:288] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719), 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
I20260807 06:46:23.526014 5082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.523212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44517 (local address 127.11.137.129:49033)
0807 06:46:23.523277 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.523288 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.523354 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.523556 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.523557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.523559 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:23.523637 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.523639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.524280 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.524281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.525095 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.525097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.525722 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.525723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.525803 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.525828 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.525894 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.525937 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":6}
I20260807 06:46:23.526014 5550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.523287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:49033 (local address 127.11.137.131:44517)
0807 06:46:23.523349 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.523351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.523364 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:46:23.523447 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.523448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.523464 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.523522 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:23.523712 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.524190 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.525200 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.525629 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.525722 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.525731 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.525914 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.525954 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:46:23.526293 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.523491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45719 (local address 127.11.137.129:47915)
0807 06:46:23.523625 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.523634 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:23.523704 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:23.523856 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:23.523856 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:23.523858 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:46:23.523952 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.523953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.524589 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.524589 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.525409 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:23.525411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.525987 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.525989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:23.526054 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.526057 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:46:23.526129 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 06:46:23.526191 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":96,"threads_started":1}
I20260807 06:46:23.526329 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.523310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:47915 (local address 127.11.137.130:45719)
0807 06:46:23.523414 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.523416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.523694 (+ 278us) server_negotiation.cc:407] Connection header received
0807 06:46:23.523780 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.523781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.523793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.523853 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:46:23.524032 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.524500 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.525498 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.525868 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.525950 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.525958 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.526224 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.526268 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:46:23.526463 5448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf18d6183d4468fb01677adee491db7" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" is_pre_election: true
I20260807 06:46:23.526669 5448 raft_consensus.cc:2454] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 0.
I20260807 06:46:23.526657 5228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf18d6183d4468fb01677adee491db7" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b57b916966144f8885fb01223ca82d4" is_pre_election: true
I20260807 06:46:23.526834 5228 raft_consensus.cc:2454] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 0.
I20260807 06:46:23.526924 4893 leader_election.cc:302] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b, 8cb12eb29cea47ca8655ea5c915e1c92; no voters:
I20260807 06:46:23.527069 5078 raft_consensus.cc:2781] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:46:23.527161 5078 raft_consensus.cc:482] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:46:23.527197 5078 raft_consensus.cc:3037] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:23.527915 5078 raft_consensus.cc:504] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.528066 5078 leader_election.cc:288] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 election: Requested vote from peers 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719), 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
I20260807 06:46:23.528252 5448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf18d6183d4468fb01677adee491db7" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
I20260807 06:46:23.528270 5228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf18d6183d4468fb01677adee491db7" candidate_uuid: "426188b7b6ea45a79b2e1ede27fe753b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b57b916966144f8885fb01223ca82d4"
I20260807 06:46:23.528321 5448 raft_consensus.cc:3037] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:23.528357 5228 raft_consensus.cc:3037] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:46:23.529050 5448 raft_consensus.cc:2454] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 1.
I20260807 06:46:23.529084 5228 raft_consensus.cc:2454] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 426188b7b6ea45a79b2e1ede27fe753b in term 1.
I20260807 06:46:23.529249 4893 leader_election.cc:302] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b, 8cb12eb29cea47ca8655ea5c915e1c92; no voters:
I20260807 06:46:23.529340 5078 raft_consensus.cc:2781] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:46:23.529510 5078 raft_consensus.cc:686] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 LEADER]: Becoming Leader. State: Replica: 426188b7b6ea45a79b2e1ede27fe753b, State: Running, Role: LEADER
I20260807 06:46:23.529594 5078 consensus_queue.cc:237] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:23.530422 4765 catalog_manager.cc:5495] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b reported cstate change: term changed from 0 to 1, leader changed from <none> to 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129). New cstate: current_term: 1 leader_uuid: "426188b7b6ea45a79b2e1ede27fe753b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260807 06:46:23.560009 5094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.557689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.11.137.129:45553)
0807 06:46:23.557771 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:23.557772 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:23.557780 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:46:23.557828 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:23.557829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:23.557845 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:23.557910 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:46:23.558009 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.558522 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.559306 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:23.559514 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:23.559572 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:23.559687 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:46:23.559786 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:46:23.559861 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:23.559901 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 06:46:23.559919 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:46:23.561725 5448 raft_consensus.cc:1261] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Refusing update from remote peer 426188b7b6ea45a79b2e1ede27fe753b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:46:23.561764 5228 raft_consensus.cc:1261] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Refusing update from remote peer 426188b7b6ea45a79b2e1ede27fe753b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:46:23.562115 5561 consensus_queue.cc:1035] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:46:23.562301 5078 consensus_queue.cc:1035] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:46:23.564708 5563 mvcc.cc:205] Tried to move back new op lower bound from 7315804911865925632 to 7315804911737909248. Current Snapshot: MvccSnapshot[applied={T|T < 7315804911865925632}]
I20260807 06:46:23.565122 5566 mvcc.cc:205] Tried to move back new op lower bound from 7315804911865925632 to 7315804911737909248. Current Snapshot: MvccSnapshot[applied={T|T < 7315804911865925632}]
I20260807 06:46:23.565553 5565 mvcc.cc:205] Tried to move back new op lower bound from 7315804911865925632 to 7315804911737909248. Current Snapshot: MvccSnapshot[applied={T|T < 7315804911865925632}]
I20260807 06:46:23.566911 4766 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:46:23.567003 4766 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:46:23.567756 4766 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Sending DeleteTablet for 3 replicas of tablet acf18d6183d4468fb01677adee491db7
I20260807 06:46:23.568045 4979 tablet_service.cc:1514] Processing DeleteTablet for tablet acf18d6183d4468fb01677adee491db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:23 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:42380
I20260807 06:46:23.568032 5196 tablet_service.cc:1514] Processing DeleteTablet for tablet acf18d6183d4468fb01677adee491db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:23 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:43916
I20260807 06:46:23.568146 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 4836
I20260807 06:46:23.568140 5422 tablet_service.cc:1514] Processing DeleteTablet for tablet acf18d6183d4468fb01677adee491db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:46:23 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:53814
I20260807 06:46:23.568354 5582 tablet_replica.cc:330] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: stopping tablet replica
I20260807 06:46:23.568454 5582 raft_consensus.cc:2229] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:46:23.568548 5582 raft_consensus.cc:2258] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:46:23.577786 5582 ts_tablet_manager.cc:1905] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:46:23.579834 5582 ts_tablet_manager.cc:1918] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:46:23.579918 5582 log.cc:1196] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/acf18d6183d4468fb01677adee491db7
I20260807 06:46:23.580237 5582 ts_tablet_manager.cc:1939] T acf18d6183d4468fb01677adee491db7 P 4b57b916966144f8885fb01223ca82d4: Deleting consensus metadata
I20260807 06:46:23.580703 4750 catalog_manager.cc:4841] TS 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719): tablet acf18d6183d4468fb01677adee491db7 (table test-table [id=7b6b41eecf914381957759b19a93bfb7]) successfully deleted
I20260807 06:46:23.581389 5584 tablet_replica.cc:330] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: stopping tablet replica
I20260807 06:46:23.581527 5584 raft_consensus.cc:2229] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:46:23.581671 5584 raft_consensus.cc:2258] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:46:23.582067 5584 ts_tablet_manager.cc:1905] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:46:23.583516 5584 ts_tablet_manager.cc:1918] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:46:23.583603 5584 log.cc:1196] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/acf18d6183d4468fb01677adee491db7
I20260807 06:46:23.583889 5584 ts_tablet_manager.cc:1939] T acf18d6183d4468fb01677adee491db7 P 8cb12eb29cea47ca8655ea5c915e1c92: Deleting consensus metadata
I20260807 06:46:23.584321 4746 catalog_manager.cc:4841] TS 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517): tablet acf18d6183d4468fb01677adee491db7 (table test-table [id=7b6b41eecf914381957759b19a93bfb7]) successfully deleted
W20260807 06:46:23.585011 4750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:45553 (error 108)
I20260807 06:46:23.585352 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 5090
I20260807 06:46:23.588133 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:23.585421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:45553 (local address 127.0.0.1:42394)
0807 06:46:23.588055 (+ 2634us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:23.588102 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:45553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2612}
W20260807 06:46:23.589938 4750 catalog_manager.cc:4584] TS 426188b7b6ea45a79b2e1ede27fe753b (127.11.137.129:45553): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet acf18d6183d4468fb01677adee491db7: Network error: Client connection negotiation failed: client connection to 127.11.137.129:45553: connect: Connection refused (error 111)
I20260807 06:46:23.596573 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 5309
I20260807 06:46:23.620352 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 4714
I20260807 06:46:43.632452 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40307
--webserver_interface=127.11.137.190
--webserver_port=34613
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:40307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:43.718451 5587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:43.718643 5587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:43.718665 5587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:43.719836 5587 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:46:43.719874 5587 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:46:43.719887 5587 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:46:43.719899 5587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:46:43.719951 5587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:43.719977 5587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:43.720002 5587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:46:43.720031 5587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:46:43.721549 5587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:40307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=34613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:43.721809 5587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:43.722054 5587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:43.727121 5593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:43.727077 5592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:43.727273 5587 server_base.cc:1034] running on GCE node
W20260807 06:46:43.727089 5597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:43.727561 5587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:43.727883 5587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:43.729048 5587 hybrid_clock.cc:648] HybridClock initialized: now 1786085203729034 us; error 27 us; skew 500 ppm
Aug 07 06:46:43 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085203, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:43.735893 5587 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:46:43.736387 5587 webserver.cc:460] Webserver started at http://127.11.137.190:34613/ using document root <none> and password file <none>
I20260807 06:46:43.736634 5587 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:43.736706 5587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:43.738189 5587 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:46:43.738881 5609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:43.739105 5587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:46:43.739217 5587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "e2851a0f41fc41b0a6898c9c293c9dc4"
format_stamp: "Formatted at 2026-08-07 06:46:01 on dist-test-slave-8hhm"
server_key: "aacaceada58b528d18136f010d0f4e06"
server_key_iv: "03f31aa21dca5204bcbb73c790dce017"
server_key_version: "encryptionkey@0"
I20260807 06:46:43.739557 5587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:43.755275 5587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:43.757155 5587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:43.757385 5587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:43.761847 5587 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:40307
I20260807 06:46:43.761883 5698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:40307 every 8 connection(s)
I20260807 06:46:43.762275 5587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:46:43.763715 5701 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:46:43.764411 5701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap starting.
I20260807 06:46:43.768977 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 5587
I20260807 06:46:43.769315 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:45553
--local_ip_for_outbound_sockets=127.11.137.129
--tserver_master_addrs=127.11.137.190:40307
--webserver_port=43941
--webserver_interface=127.11.137.129
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:46:43.773797 5701 log.cc:824] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:43.775949 5701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:46:43.776276 5701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Bootstrap complete.
I20260807 06:46:43.778568 5701 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:43.778785 5701 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2851a0f41fc41b0a6898c9c293c9dc4, State: Initialized, Role: FOLLOWER
I20260807 06:46:43.778952 5701 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:43.779016 5701 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:46:43.779078 5701 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:46:43.779121 5701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:46:43.780110 5701 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:43.780236 5701 leader_election.cc:302] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2851a0f41fc41b0a6898c9c293c9dc4; no voters:
I20260807 06:46:43.780435 5701 leader_election.cc:288] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 06:46:43.780476 5705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:46:43.780663 5705 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [term 3 LEADER]: Becoming Leader. State: Replica: e2851a0f41fc41b0a6898c9c293c9dc4, State: Running, Role: LEADER
I20260807 06:46:43.780707 5701 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:46:43.780815 5705 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } }
I20260807 06:46:43.781221 5707 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } } }
I20260807 06:46:43.781317 5707 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 06:46:43.781541 5708 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2851a0f41fc41b0a6898c9c293c9dc4. Latest consensus state: current_term: 3 leader_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2851a0f41fc41b0a6898c9c293c9dc4" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40307 } } }
I20260807 06:46:43.781606 5718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:46:43.781683 5708 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 06:46:43.782544 5718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:46:43.782709 5718 catalog_manager.cc:1259] Loaded cluster ID: bf1d5c1dd86944f4997fd110655885b6
I20260807 06:46:43.782938 5718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:46:43.784108 5718 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:46:43.784302 5718 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Loaded TSK: 0
I20260807 06:46:43.784354 5718 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e2851a0f41fc41b0a6898c9c293c9dc4: Loaded TSK: 1
F20260807 06:46:43.784600 5718 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8daac469ad google::LogMessage::Fail() at ??:0
@ 0x7f8daac4988a google::LogMessage::SendToLog() at ??:0
@ 0x7f8daac464de google::LogMessage::Flush() at ??:0
@ 0x7f8daac47a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8dad3b3104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8dad3b0d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8db2ba01cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8db2ba048e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8db2ba0594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f8db2b66c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f8db2b70ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8dacb140d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8dacb09954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8dad96d6db start_thread at ??:0
@ 0x7f8da974461f clone at ??:0
W20260807 06:46:43.872823 5703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:43.873023 5703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:43.873047 5703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:43.874238 5703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:43.874281 5703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:43.874308 5703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:46:43.875751 5703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:45553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=43941
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:43.875989 5703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:43.876258 5703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:43.881493 5771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:43.881692 5772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:43.881704 5703 server_base.cc:1034] running on GCE node
W20260807 06:46:43.881533 5774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:43.881992 5703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:43.882272 5703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:43.883435 5703 hybrid_clock.cc:648] HybridClock initialized: now 1786085203883411 us; error 43 us; skew 500 ppm
Aug 07 06:46:43 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085203, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:43.886183 5703 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:46:43.886665 5703 webserver.cc:460] Webserver started at http://127.11.137.129:43941/ using document root <none> and password file <none>
I20260807 06:46:43.886894 5703 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:43.886966 5703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:43.888464 5703 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:46:43.889302 5784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:43.889487 5703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:46:43.889626 5703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "426188b7b6ea45a79b2e1ede27fe753b"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "927748862d910889ca99bec1430dcef9"
server_key_iv: "4715684e0183e8780695c59fa2a8a1f9"
server_key_version: "encryptionkey@0"
I20260807 06:46:43.890004 5703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:43.914829 5703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:43.917191 5703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:43.917392 5703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:43.917658 5703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:43.918113 5800 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:46:43.920182 5703 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:46:43.920257 5703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 06:46:43.920303 5703 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:46:43.920967 5703 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:46:43.921025 5703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 06:46:43.921105 5800 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap starting.
I20260807 06:46:43.928815 5703 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:45553
I20260807 06:46:43.929044 5967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:45553 every 8 connection(s)
I20260807 06:46:43.929293 5703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:46:43.932494 5800 log.cc:824] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:46:43.935214 5800 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:46:43.935537 5800 tablet_bootstrap.cc:492] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Bootstrap complete.
I20260807 06:46:43.935678 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 5703
I20260807 06:46:43.935971 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:45719
--local_ip_for_outbound_sockets=127.11.137.130
--tserver_master_addrs=127.11.137.190:40307
--webserver_port=42967
--webserver_interface=127.11.137.130
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:46:43.936812 5800 ts_tablet_manager.cc:1397] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.005s
I20260807 06:46:43.938283 5800 raft_consensus.cc:348] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:43.938627 5800 raft_consensus.cc:729] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426188b7b6ea45a79b2e1ede27fe753b, State: Initialized, Role: FOLLOWER
I20260807 06:46:43.938767 5800 consensus_queue.cc:260] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:43.939049 5800 ts_tablet_manager.cc:1428] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
W20260807 06:46:43.987615 5970 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:46:43.930007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:54765)
0807 06:46:43.930186 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:43.930229 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:43.930664 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:43.987368 (+ 56704us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
W20260807 06:46:43.987891 5968 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:40307 (0 consecutive failures): Network error: Failed to ping master at 127.11.137.190:40307: Client connection negotiation failed: client connection to 127.11.137.190:40307: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:46:43.988246 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:43.988122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:50383)
0807 06:46:43.988176 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:43.988227 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 06:46:43.988624 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:43.988530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:60535)
0807 06:46:43.988578 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:43.988602 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 06:46:43.988739 5968 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:46:44.022910 5979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:44.023172 5979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:44.023226 5979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:44.024387 5979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:44.024456 5979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:44.024501 5979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:46:44.026031 5979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:45719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=42967
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:44.026310 5979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:44.026532 5979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:44.031453 5991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:44.031452 5996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:44.031626 5979 server_base.cc:1034] running on GCE node
W20260807 06:46:44.031508 5992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:44.031915 5979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:44.032107 5979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:44.033269 5979 hybrid_clock.cc:648] HybridClock initialized: now 1786085204033257 us; error 29 us; skew 500 ppm
Aug 07 06:46:44 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085204, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:44.035630 5979 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:46:44.036062 5979 webserver.cc:460] Webserver started at http://127.11.137.130:42967/ using document root <none> and password file <none>
I20260807 06:46:44.036262 5979 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:44.036300 5979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:44.037560 5979 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:46:44.038144 6008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.038326 5979 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:46:44.038419 5979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "4b57b916966144f8885fb01223ca82d4"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "ac0d0c0c36029be61cc42b52f417a5ef"
server_key_iv: "fc6c71ed73099b93b4cf7ffea8116a26"
server_key_version: "encryptionkey@0"
I20260807 06:46:44.038745 5979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:44.055692 5979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:44.058363 5979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:44.058530 5979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:44.058779 5979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:44.059154 5979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:44.059206 5979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.059230 5979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:44.059278 5979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.065408 5979 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:45719
I20260807 06:46:44.065493 6206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:45719 every 8 connection(s)
I20260807 06:46:44.065886 5979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:46:44.067130 6215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.066738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:54121)
0807 06:46:44.066917 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.066991 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
W20260807 06:46:44.067672 6208 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:40307 (0 consecutive failures): Network error: Failed to ping master at 127.11.137.190:40307: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
I20260807 06:46:44.067950 6215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.067856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:50431)
0807 06:46:44.067903 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.067930 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 06:46:44.068194 6215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.068137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:37783)
0807 06:46:44.068158 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.068183 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260807 06:46:44.068302 6208 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:46:44.073246 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 5979
I20260807 06:46:44.073537 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:44517
--local_ip_for_outbound_sockets=127.11.137.131
--tserver_master_addrs=127.11.137.190:40307
--webserver_port=42063
--webserver_interface=127.11.137.131
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:38593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:46:44.156112 6217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:46:44.156345 6217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:46:44.156383 6217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:46:44.157644 6217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:46:44.157707 6217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:46:44.157750 6217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:46:44.159350 6217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:38593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:44517
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=42063
--tserver_master_addrs=127.11.137.190:40307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:46:44.159636 6217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:46:44.159868 6217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:46:44.165314 6230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:44.165362 6227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:46:44.165314 6226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:46:44.165409 6217 server_base.cc:1034] running on GCE node
I20260807 06:46:44.165680 6217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:46:44.165966 6217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:46:44.167141 6217 hybrid_clock.cc:648] HybridClock initialized: now 1786085204167153 us; error 54 us; skew 500 ppm
Aug 07 06:46:44 dist-test-slave-8hhm krb5kdc[3827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085204, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:46:44.169766 6217 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:46:44.170192 6217 webserver.cc:460] Webserver started at http://127.11.137.131:42063/ using document root <none> and password file <none>
I20260807 06:46:44.170437 6217 fs_manager.cc:359] Metadata directory not provided
I20260807 06:46:44.170508 6217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:46:44.171857 6217 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 06:46:44.172454 6245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.172631 6217 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.172726 6217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "8cb12eb29cea47ca8655ea5c915e1c92"
format_stamp: "Formatted at 2026-08-07 06:46:02 on dist-test-slave-8hhm"
server_key: "edf9167424ae5c7882a5fd0fa7360427"
server_key_iv: "978bfd7f69f8ff47a982ec710d60094a"
server_key_version: "encryptionkey@0"
I20260807 06:46:44.173087 6217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:46:44.219666 6217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:46:44.221748 6217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:46:44.221865 6217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:46:44.222081 6217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:46:44.222419 6217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:46:44.222476 6217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.222520 6217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:46:44.222548 6217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:46:44.228546 6217 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:44517
I20260807 06:46:44.228658 6432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:44517 every 8 connection(s)
I20260807 06:46:44.228986 6217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:46:44.229702 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 6217
I20260807 06:46:44.230275 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.229861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:56483)
0807 06:46:44.230026 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.230104 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
W20260807 06:46:44.230706 6433 heartbeater.cc:644] Failed to heartbeat to 127.11.137.190:40307 (0 consecutive failures): Network error: Failed to ping master at 127.11.137.190:40307: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
I20260807 06:46:44.231012 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.230932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:39187)
0807 06:46:44.230965 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.230993 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260807 06:46:44.231272 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.231215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:58415)
0807 06:46:44.231239 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.231258 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260807 06:46:44.231389 6433 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:46:44.989411 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:44.989152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:46765)
0807 06:46:44.989315 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:44.989347 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260807 06:46:45.068943 6441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.068675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:53037)
0807 06:46:45.068843 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:45.068879 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":104,"threads_started":1}
I20260807 06:46:45.182394 6442 raft_consensus.cc:482] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:46:45.182564 6442 raft_consensus.cc:504] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:45.182924 6442 leader_election.cc:288] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719), 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
Aug 07 06:46:45 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085203, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.131@KRBTEST.COM
Aug 07 06:46:45 dist-test-slave-8hhm krb5kdc[3827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085203, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.130@KRBTEST.COM
I20260807 06:46:45.194039 6447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.183284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:45983 (local address 127.11.137.131:44517)
0807 06:46:45.183469 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:45.183479 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:45.183500 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:46:45.184009 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:45.184012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:45.184063 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:45.184225 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:45.185000 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.186068 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.186882 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.187336 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.187491 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:45.190083 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:45.190087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:45.190088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:45.190098 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:45.192152 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:45.192704 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:45.192707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:45.192707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:45.192803 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:45.193069 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:45.193070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:45.193070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:45.193464 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:45.193546 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:45.193775 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 06:46:45.193937 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":53,"threads_started":1}
I20260807 06:46:45.194039 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.183135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:45719 (local address 127.11.137.129:43373)
0807 06:46:45.183214 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:45.183225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:45.183294 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:45.184231 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:45.184234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:45.184628 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:45.184836 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:45.184842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.185994 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.185995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:45.186743 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:45.186745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.187340 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.187341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:45.187452 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:45.188074 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:45.188093 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:45.190434 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:45.192358 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:45.192359 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:45.192359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:45.192591 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:45.192848 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:45.192849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:45.192849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:45.192967 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:45.193428 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:45.193435 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:45.193590 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 06:46:45.193693 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:46:45.193930 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":25}
I20260807 06:46:45.194069 6444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.183273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:43373 (local address 127.11.137.130:45719)
0807 06:46:45.183453 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 06:46:45.183463 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:46:45.183493 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:46:45.183986 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:46:45.183988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:46:45.184029 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:46:45.184208 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:46:45.184971 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.185885 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.186843 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.187247 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.187381 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:45.190542 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:46:45.190547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:46:45.190548 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:46:45.190573 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:46:45.192277 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:45.192675 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:45.192678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:45.192679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:45.192777 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:46:45.193038 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:46:45.193039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:46:45.193039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:46:45.193370 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:46:45.193461 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 06:46:45.193756 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 06:46:45.193947 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":61,"threads_started":1}
I20260807 06:46:45.194149 6443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.183173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:44517 (local address 127.11.137.129:45983)
0807 06:46:45.183288 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:45.183298 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:46:45.183343 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:46:45.184243 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:46:45.184244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:46:45.184637 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:46:45.184836 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:45.184843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.186191 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.186192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:45.186763 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:46:45.186765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:46:45.187463 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:46:45.187464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:46:45.187524 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:46:45.188230 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:46:45.188234 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:46:45.189953 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:46:45.192237 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:45.192244 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:45.192246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:45.192593 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:45.192909 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:46:45.192909 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:46:45.192910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:46:45.192978 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:46:45.193529 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:46:45.193530 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:46:45.193584 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 06:46:45.193692 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 06:46:45.194014 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":167,"thread_start_us":61,"threads_started":1}
W20260807 06:46:45.194954 5790 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
W20260807 06:46:45.195737 5785 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
I20260807 06:46:45.195798 5785 leader_election.cc:302] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b; no voters: 4b57b916966144f8885fb01223ca82d4, 8cb12eb29cea47ca8655ea5c915e1c92
I20260807 06:46:45.195905 6442 raft_consensus.cc:2726] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:46:45.231971 6448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.231739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:48213)
0807 06:46:45.231874 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:45.231933 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260807 06:46:45.990073 6449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:45.989849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:38375)
0807 06:46:45.989988 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:45.990026 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260807 06:46:46.069676 6450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:46.069473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:56515)
0807 06:46:46.069598 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:46.069635 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260807 06:46:46.232601 6451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:46.232394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:58865)
0807 06:46:46.232518 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:46.232554 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260807 06:46:46.816493 6452 raft_consensus.cc:482] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:46:46.816596 6452 raft_consensus.cc:504] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:46.816766 6452 leader_election.cc:288] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719), 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
W20260807 06:46:46.817232 5785 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
W20260807 06:46:46.817338 5790 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
I20260807 06:46:46.817464 5790 leader_election.cc:302] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b; no voters: 4b57b916966144f8885fb01223ca82d4, 8cb12eb29cea47ca8655ea5c915e1c92
I20260807 06:46:46.817548 6452 raft_consensus.cc:2726] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:46:46.990731 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:46.990502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:36645)
0807 06:46:46.990637 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:46.990672 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260807 06:46:47.070364 6456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:47.070161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:59225)
0807 06:46:47.070289 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:47.070325 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260807 06:46:47.233295 6457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:47.233072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:54503)
0807 06:46:47.233205 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:47.233256 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260807 06:46:47.991444 6458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:47.991249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:33843)
0807 06:46:47.991364 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:47.991397 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260807 06:46:48.071206 6461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:48.070985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:45471)
0807 06:46:48.071132 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:48.071165 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260807 06:46:48.233990 6462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:48.233747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:36529)
0807 06:46:48.233911 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:48.233948 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
I20260807 06:46:48.992260 6465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:48.991926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:54535)
0807 06:46:48.992069 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:48.992168 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":60,"threads_started":1}
I20260807 06:46:49.071821 6466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:49.071613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:52617)
0807 06:46:49.071743 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:49.071780 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260807 06:46:49.188552 6468 raft_consensus.cc:482] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:46:49.188652 6468 raft_consensus.cc:504] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:49.188823 6468 leader_election.cc:288] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719), 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
W20260807 06:46:49.189262 5790 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
W20260807 06:46:49.189352 5785 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
I20260807 06:46:49.189440 5785 leader_election.cc:302] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b; no voters: 4b57b916966144f8885fb01223ca82d4, 8cb12eb29cea47ca8655ea5c915e1c92
I20260807 06:46:49.189532 6468 raft_consensus.cc:2726] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:46:49.234663 6470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:49.234443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:45293)
0807 06:46:49.234590 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:49.234622 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260807 06:46:49.992936 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:49.992719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:60671)
0807 06:46:49.992846 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:49.992887 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260807 06:46:50.072454 6472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:50.072226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:51489)
0807 06:46:50.072367 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:50.072405 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":61,"threads_started":1}
I20260807 06:46:50.235323 6474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:50.235090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:48237)
0807 06:46:50.235248 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:50.235284 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260807 06:46:50.993656 6475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:50.993422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:42101)
0807 06:46:50.993578 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:50.993611 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260807 06:46:51.073179 6477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:51.072924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:38939)
0807 06:46:51.073096 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:51.073136 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":72,"threads_started":1}
I20260807 06:46:51.236101 6480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:51.235902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:57519)
0807 06:46:51.236023 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:51.236059 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260807 06:46:51.994343 6483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:51.994132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:33483)
0807 06:46:51.994257 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:51.994297 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260807 06:46:52.073908 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:52.073696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:35521)
0807 06:46:52.073837 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:52.073869 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260807 06:46:52.212317 6489 raft_consensus.cc:482] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:46:52.212441 6489 raft_consensus.cc:504] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b57b916966144f8885fb01223ca82d4" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 45719 } } peers { permanent_uuid: "8cb12eb29cea47ca8655ea5c915e1c92" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 44517 } } peers { permanent_uuid: "426188b7b6ea45a79b2e1ede27fe753b" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 45553 } }
I20260807 06:46:52.212637 6489 leader_election.cc:288] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719), 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517)
W20260807 06:46:52.213059 5785 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cb12eb29cea47ca8655ea5c915e1c92 (127.11.137.131:44517): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
W20260807 06:46:52.213153 5790 leader_election.cc:341] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b57b916966144f8885fb01223ca82d4 (127.11.137.130:45719): Not found: Tablet not found: acf18d6183d4468fb01677adee491db7
I20260807 06:46:52.213249 5790 leader_election.cc:302] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 426188b7b6ea45a79b2e1ede27fe753b; no voters: 4b57b916966144f8885fb01223ca82d4, 8cb12eb29cea47ca8655ea5c915e1c92
I20260807 06:46:52.213326 6489 raft_consensus.cc:2726] T acf18d6183d4468fb01677adee491db7 P 426188b7b6ea45a79b2e1ede27fe753b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:46:52.236740 6490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:52.236498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:50373)
0807 06:46:52.236649 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:52.236685 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":56,"threads_started":1}
I20260807 06:46:52.994978 6493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:52.994778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:41807)
0807 06:46:52.994900 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:52.994932 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260807 06:46:53.074610 6494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:53.074405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:60439)
0807 06:46:53.074529 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:53.074568 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260807 06:46:53.237506 6495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:53.237316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:39115)
0807 06:46:53.237435 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:53.237468 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260807 06:46:53.995684 6496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:53.995407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:44247)
0807 06:46:53.995586 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:53.995637 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260807 06:46:54.075289 6497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:54.075064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:35841)
0807 06:46:54.075204 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:54.075244 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260807 06:46:54.238088 6499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:54.237880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:52545)
0807 06:46:54.238015 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:54.238045 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260807 06:46:54.996447 6501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:54.996233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:43837)
0807 06:46:54.996364 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:54.996401 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260807 06:46:55.075896 6502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:55.075696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:48203)
0807 06:46:55.075816 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:55.075852 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260807 06:46:55.238798 6503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:55.238557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:37867)
0807 06:46:55.238713 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:55.238752 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":82,"threads_started":1}
I20260807 06:46:55.997347 6505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:55.997070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:39017)
0807 06:46:55.997243 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:55.997296 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260807 06:46:56.076648 6507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:56.076379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:55611)
0807 06:46:56.076553 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:56.076603 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":64,"threads_started":1}
I20260807 06:46:56.239624 6509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:56.239331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:60017)
0807 06:46:56.239526 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:56.239575 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":65,"threads_started":1}
I20260807 06:46:56.997992 6511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:56.997787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:53847)
0807 06:46:56.997912 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:56.997945 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260807 06:46:57.077335 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:57.077097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:41261)
0807 06:46:57.077249 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:57.077289 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
I20260807 06:46:57.240347 6513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:57.240125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:53101)
0807 06:46:57.240268 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:57.240300 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260807 06:46:57.998703 6514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:57.998460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:42477)
0807 06:46:57.998600 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:57.998638 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260807 06:46:58.078009 6515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:58.077786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:48471)
0807 06:46:58.077927 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:58.077963 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260807 06:46:58.241092 6517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:58.240840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:45913)
0807 06:46:58.240987 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:58.241045 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":76,"threads_started":1}
I20260807 06:46:58.999480 6519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:58.999268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.129:34885)
0807 06:46:58.999400 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:58.999434 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260807 06:46:59.078814 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:59.078592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.130:58657)
0807 06:46:59.078734 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:59.078769 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
I20260807 06:46:59.231647 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 5703
I20260807 06:46:59.242871 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:46:59.242595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40307 (local address 127.11.137.131:34307)
0807 06:46:59.242766 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 06:46:59.242817 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.190:40307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":58,"threads_started":1}
I20260807 06:46:59.248199 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 5979
I20260807 06:46:59.267596 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 6217
2026-08-07T06:46:59Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58829 ms)
[----------] 30 tests from SecurityITest (239426 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:46:59 dist-test-slave-8hhm krb5kdc[6527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:46:59 dist-test-slave-8hhm krb5kdc[6527](info): set up 2 sockets
Aug 07 06:46:59 dist-test-slave-8hhm krb5kdc[6527](info): commencing operation
krb5kdc: starting...
W20260807 06:47:00.523835 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:00 dist-test-slave-8hhm krb5kdc[6527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:00.644794 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40179
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:40179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:00.726148 6556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:00.726348 6556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:00.726369 6556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:00.727430 6556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:00.727463 6556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:00.727476 6556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:00.727488 6556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:00.727499 6556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:00.728893 6556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:40179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:40179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:00.729075 6556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:00.729318 6556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:00.734546 6566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:00.734555 6568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:00.734573 6556 server_base.cc:1034] running on GCE node
W20260807 06:47:00.734563 6565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:00.735019 6556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:00.735329 6556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:00.736472 6556 hybrid_clock.cc:648] HybridClock initialized: now 1786085220736456 us; error 38 us; skew 500 ppm
Aug 07 06:47:00 dist-test-slave-8hhm krb5kdc[6527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:00.742549 6556 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:00.742954 6556 webserver.cc:460] Webserver started at http://127.11.137.190:40823/ using document root <none> and password file <none>
I20260807 06:47:00.743219 6556 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:00.743290 6556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:00.743439 6556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:00.744491 6556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "209a8055b676424abc76e8c15a6ce8e9"
format_stamp: "Formatted at 2026-08-07 06:47:00 on dist-test-slave-8hhm"
server_key: "d516687005b807288f6fe0d9f6824037"
server_key_iv: "6a3e873739029af4c2d12c58974ad191"
server_key_version: "encryptionkey@0"
I20260807 06:47:00.744874 6556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "209a8055b676424abc76e8c15a6ce8e9"
format_stamp: "Formatted at 2026-08-07 06:47:00 on dist-test-slave-8hhm"
server_key: "d516687005b807288f6fe0d9f6824037"
server_key_iv: "6a3e873739029af4c2d12c58974ad191"
server_key_version: "encryptionkey@0"
I20260807 06:47:00.746263 6556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:00.747186 6584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:00.747417 6556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:00.747531 6556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "209a8055b676424abc76e8c15a6ce8e9"
format_stamp: "Formatted at 2026-08-07 06:47:00 on dist-test-slave-8hhm"
server_key: "d516687005b807288f6fe0d9f6824037"
server_key_iv: "6a3e873739029af4c2d12c58974ad191"
server_key_version: "encryptionkey@0"
I20260807 06:47:00.747612 6556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:00.762770 6556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:00.765117 6556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:00.765319 6556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:00.769273 6556 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:40179
I20260807 06:47:00.769302 6664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:40179 every 8 connection(s)
I20260807 06:47:00.769659 6556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:00.770231 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 6556
I20260807 06:47:00.770357 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:00.770545 11814 external_mini_cluster.cc:1428] Setting key ff3c425a2f922d02a545caf3dca86a1d
I20260807 06:47:00.770686 6666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:00.774220 6666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9: Bootstrap starting.
I20260807 06:47:00.774982 6666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:00.775312 6666 log.cc:824] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:00.776153 6666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9: No bootstrap required, opened a new log
Aug 07 06:47:00 dist-test-slave-8hhm krb5kdc[6527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:00.778568 6666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209a8055b676424abc76e8c15a6ce8e9" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40179 } }
I20260807 06:47:00.778759 6666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:00.778813 6666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 209a8055b676424abc76e8c15a6ce8e9, State: Initialized, Role: FOLLOWER
I20260807 06:47:00.778944 6666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209a8055b676424abc76e8c15a6ce8e9" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40179 } }
I20260807 06:47:00.779029 6666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:00.779062 6666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:00.779109 6666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:00.779657 6666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209a8055b676424abc76e8c15a6ce8e9" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40179 } }
I20260807 06:47:00.779789 6666 leader_election.cc:302] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 209a8055b676424abc76e8c15a6ce8e9; no voters:
I20260807 06:47:00.779958 6666 leader_election.cc:288] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:00.780032 6674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:00.780222 6674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [term 1 LEADER]: Becoming Leader. State: Replica: 209a8055b676424abc76e8c15a6ce8e9, State: Running, Role: LEADER
I20260807 06:47:00.780347 6666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:00.780359 6674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209a8055b676424abc76e8c15a6ce8e9" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40179 } }
I20260807 06:47:00.780864 6676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 209a8055b676424abc76e8c15a6ce8e9. Latest consensus state: current_term: 1 leader_uuid: "209a8055b676424abc76e8c15a6ce8e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209a8055b676424abc76e8c15a6ce8e9" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40179 } } }
I20260807 06:47:00.781018 6676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:00.781267 6675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "209a8055b676424abc76e8c15a6ce8e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209a8055b676424abc76e8c15a6ce8e9" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 40179 } } }
I20260807 06:47:00.781418 6675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:00.781642 6687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:00.782135 6672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:00.771080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57648 (local address 127.11.137.190:40179)
0807 06:47:00.771264 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:00.771272 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:00.771307 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:47:00.771913 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:00.771920 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:00.771968 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:00.772084 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:00.772913 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:00.773859 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:00.774946 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:00.775391 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:00.775512 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:00.778121 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:00.778125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:00.778125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:00.778135 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:00.779831 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:00.780288 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:00.780291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:00.780291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:00.780442 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:00.780666 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:00.780667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:00.780667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:00.780978 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:00.781179 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:00.781672 (+ 493us) server_negotiation.cc:299] Negotiation successful
0807 06:47:00.781824 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260807 06:47:00.782213 6687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:00.783977 6687 catalog_manager.cc:1347] Generated new cluster ID: 633bf0d0448d489db0064b929119b7a2
I20260807 06:47:00.784030 6687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:00.803316 6687 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:00.803903 6687 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:00.813573 6687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9: Generated new TSK 0
I20260807 06:47:00.813771 6687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:47:00.850198 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40179
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:00.938519 6712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:00.938742 6712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:00.938766 6712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:00.939929 6712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:00.939971 6712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:00.940028 6712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:47:00.941519 6712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:00.941807 6712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:00.942091 6712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:00.947690 6725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:00.947723 6728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:00.947885 6712 server_base.cc:1034] running on GCE node
W20260807 06:47:00.947999 6724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:00.948237 6712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:00.948472 6712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:00.949625 6712 hybrid_clock.cc:648] HybridClock initialized: now 1786085220949619 us; error 33 us; skew 500 ppm
Aug 07 06:47:00 dist-test-slave-8hhm krb5kdc[6527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:00.952263 6712 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:47:00.952684 6712 webserver.cc:460] Webserver started at http://127.11.137.129:34067/ using document root <none> and password file <none>
I20260807 06:47:00.952911 6712 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:00.952980 6712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:00.953135 6712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:00.954250 6712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "9f607fd7c85c428583dd6ecc3901a5fb"
format_stamp: "Formatted at 2026-08-07 06:47:00 on dist-test-slave-8hhm"
server_key: "3323582dc678cfc3a305da6c2c92dbb9"
server_key_iv: "8d6922968370df1fd08f6a386ecbaf7b"
server_key_version: "encryptionkey@0"
I20260807 06:47:00.954629 6712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "9f607fd7c85c428583dd6ecc3901a5fb"
format_stamp: "Formatted at 2026-08-07 06:47:00 on dist-test-slave-8hhm"
server_key: "3323582dc678cfc3a305da6c2c92dbb9"
server_key_iv: "8d6922968370df1fd08f6a386ecbaf7b"
server_key_version: "encryptionkey@0"
I20260807 06:47:00.955972 6712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:00.956682 6741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:00.956857 6712 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:00.956962 6712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "9f607fd7c85c428583dd6ecc3901a5fb"
format_stamp: "Formatted at 2026-08-07 06:47:00 on dist-test-slave-8hhm"
server_key: "3323582dc678cfc3a305da6c2c92dbb9"
server_key_iv: "8d6922968370df1fd08f6a386ecbaf7b"
server_key_version: "encryptionkey@0"
I20260807 06:47:00.957046 6712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:00.994094 6712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:00.996290 6712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:00.996460 6712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:00.996728 6712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:00.997068 6712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:00.997126 6712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:00.997164 6712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:00.997192 6712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.003185 6712 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:46129
I20260807 06:47:01.003255 6923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:46129 every 8 connection(s)
I20260807 06:47:01.003566 6712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:47:01.004817 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 6712
I20260807 06:47:01.004935 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:47:01.005173 11814 external_mini_cluster.cc:1428] Setting key 19097207ec52e5e9892ff04606b8f193
Aug 07 06:47:01 dist-test-slave-8hhm krb5kdc[6527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:01.015185 6672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.004278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:39105 (local address 127.11.137.190:40179)
0807 06:47:01.004372 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.004375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.004593 (+ 218us) server_negotiation.cc:407] Connection header received
0807 06:47:01.005163 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.005165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.005178 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.005278 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:01.006415 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.007176 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.008535 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.008774 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.008852 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.011775 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:01.011776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:01.011777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:01.011783 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:01.013437 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.014030 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.014031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.014032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.014095 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.014465 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.014466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.014466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.014570 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:01.014625 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.015037 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.015112 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:47:01.015482 6926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.004254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40179 (local address 127.11.137.129:39105)
0807 06:47:01.004450 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.004489 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.005039 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.005388 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.005393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.006105 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:01.006299 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.006305 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.007271 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.007272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.008412 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.008416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.008876 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.008877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.009028 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.009683 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:01.009690 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:01.011636 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:01.013536 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:01.013547 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:01.013549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:01.013925 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:01.014182 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:01.014183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:01.014184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:01.014358 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:01.014650 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:01.014659 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:01.014842 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.015009 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.015196 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":116,"threads_started":1}
I20260807 06:47:01.016181 6924 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40179
I20260807 06:47:01.016310 6924 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:01.016541 6924 heartbeater.cc:511] Master 127.11.137.190:40179 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
I20260807 06:47:01.017196 6610 ts_manager.cc:194] Registered new tserver with Master: 9f607fd7c85c428583dd6ecc3901a5fb (127.11.137.129:46129)
I20260807 06:47:01.017867 6610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:39105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:47:01.036803 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40179
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:01.119127 6935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:01.119345 6935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:01.119383 6935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:01.120496 6935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:01.120561 6935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:01.120606 6935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:47:01.122166 6935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:01.122427 6935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:01.122649 6935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:01.127727 6949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.127768 6941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.127779 6945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:01.127908 6935 server_base.cc:1034] running on GCE node
I20260807 06:47:01.128132 6935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:01.128366 6935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:01.129523 6935 hybrid_clock.cc:648] HybridClock initialized: now 1786085221129513 us; error 38 us; skew 500 ppm
Aug 07 06:47:01 dist-test-slave-8hhm krb5kdc[6527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:01.132300 6935 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:47:01.132747 6935 webserver.cc:460] Webserver started at http://127.11.137.130:41007/ using document root <none> and password file <none>
I20260807 06:47:01.132941 6935 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:01.132982 6935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:01.133077 6935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:01.134081 6935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "c4ed859c2f1842fb9af0d7770a5edd86"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "d6b5a3edb40a63310765a86bdd2da685"
server_key_iv: "b39a8394cf93b86f6e9f3e3e4157e01d"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.134372 6935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "c4ed859c2f1842fb9af0d7770a5edd86"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "d6b5a3edb40a63310765a86bdd2da685"
server_key_iv: "b39a8394cf93b86f6e9f3e3e4157e01d"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.135597 6935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:01.136260 6957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.136412 6935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:01.136499 6935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "c4ed859c2f1842fb9af0d7770a5edd86"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "d6b5a3edb40a63310765a86bdd2da685"
server_key_iv: "b39a8394cf93b86f6e9f3e3e4157e01d"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.136556 6935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:01.147644 6935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:01.149498 6935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:01.149719 6935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:01.149899 6935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:01.150204 6935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:01.150239 6935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.150260 6935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:01.150274 6935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.156172 6935 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:40311
I20260807 06:47:01.156243 7147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:40311 every 8 connection(s)
I20260807 06:47:01.156548 6935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:47:01.161883 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 6935
I20260807 06:47:01.161974 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:47:01.162204 11814 external_mini_cluster.cc:1428] Setting key fc9f89c79e20491b2d4f8241f7078caf
Aug 07 06:47:01 dist-test-slave-8hhm krb5kdc[6527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:01.165823 6672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.157307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:53479 (local address 127.11.137.190:40179)
0807 06:47:01.157362 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.157365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.157579 (+ 214us) server_negotiation.cc:407] Connection header received
0807 06:47:01.158043 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.158045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.158055 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.158108 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:01.158998 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.159464 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.160440 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.160624 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.160688 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.162989 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:01.162991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:01.162992 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:01.162999 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:01.164262 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.164765 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.164766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.164766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.164828 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.165126 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.165127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.165127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.165274 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:01.165353 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.165685 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.165759 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:47:01.166177 7150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.157288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40179 (local address 127.11.137.130:53479)
0807 06:47:01.157460 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.157495 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.157963 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.158171 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.158174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.158742 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:01.158924 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.158929 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.159544 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.159544 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.160366 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.160369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.160700 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.160700 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.160821 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.161312 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:01.161319 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:01.162886 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:01.164349 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:01.164357 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:01.164359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:01.164677 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:01.164911 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:01.164912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:01.164912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:01.165053 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:01.165360 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:01.165367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:01.165531 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.165654 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.165831 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
I20260807 06:47:01.166692 7148 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40179
I20260807 06:47:01.166821 7148 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:01.167008 7148 heartbeater.cc:511] Master 127.11.137.190:40179 requested a full tablet report, sending...
I20260807 06:47:01.167413 6610 ts_manager.cc:194] Registered new tserver with Master: c4ed859c2f1842fb9af0d7770a5edd86 (127.11.137.130:40311)
I20260807 06:47:01.167793 6610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:53479
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:47:01.190124 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40179
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:01.272516 7161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:01.272750 7161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:01.272791 7161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:01.273952 7161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:01.274019 7161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:01.274061 7161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:47:01.275533 7161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:40179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:01.275810 7161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:01.276060 7161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:01.281068 7176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.281049 7174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.281044 7172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:01.281507 7161 server_base.cc:1034] running on GCE node
I20260807 06:47:01.281705 7161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:01.281999 7161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:01.283156 7161 hybrid_clock.cc:648] HybridClock initialized: now 1786085221283138 us; error 32 us; skew 500 ppm
Aug 07 06:47:01 dist-test-slave-8hhm krb5kdc[6527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:01.285703 7161 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:47:01.286165 7161 webserver.cc:460] Webserver started at http://127.11.137.131:36125/ using document root <none> and password file <none>
I20260807 06:47:01.286419 7161 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:01.286464 7161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:01.286612 7161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:01.287632 7161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "b41319c2a7cc4b84a4f750ea551e6d12"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "e08587b325d223665f601b591306b08d"
server_key_iv: "7da4028172f2f1e6bef851c921fd5268"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.287999 7161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "b41319c2a7cc4b84a4f750ea551e6d12"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "e08587b325d223665f601b591306b08d"
server_key_iv: "7da4028172f2f1e6bef851c921fd5268"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.289315 7161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:01.290023 7190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.290215 7161 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:01.290288 7161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "b41319c2a7cc4b84a4f750ea551e6d12"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "e08587b325d223665f601b591306b08d"
server_key_iv: "7da4028172f2f1e6bef851c921fd5268"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.290380 7161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:01.303632 7161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:01.305984 7161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:01.306154 7161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:01.306391 7161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:01.306702 7161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:01.306736 7161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.306779 7161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:01.306809 7161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.312990 7161 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:35191
I20260807 06:47:01.313048 7366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:35191 every 8 connection(s)
I20260807 06:47:01.313447 7161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:47:01.314924 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 7161
I20260807 06:47:01.315014 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:47:01.315215 11814 external_mini_cluster.cc:1428] Setting key caafad990ff8094c754a3173392c9aa7
Aug 07 06:47:01 dist-test-slave-8hhm krb5kdc[6527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:01.322731 6672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.314233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:44725 (local address 127.11.137.190:40179)
0807 06:47:01.314279 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.314285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.314493 (+ 208us) server_negotiation.cc:407] Connection header received
0807 06:47:01.315114 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.315116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.315130 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.315214 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:01.316393 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.316879 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.317892 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.318074 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.318129 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.320062 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:01.320063 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:01.320064 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:01.320071 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:01.321529 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.321949 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.321950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.321950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.322003 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.322223 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.322224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.322224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.322337 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:01.322386 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.322607 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.322666 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:47:01.322965 7371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.314214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:40179 (local address 127.11.137.131:44725)
0807 06:47:01.314364 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.314406 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.314948 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.315301 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.315305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.316051 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:01.316314 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.316319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.316957 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.316957 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.317818 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.317821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.318148 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.318149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.318244 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.318663 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:01.318671 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:01.319981 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:01.321619 (+ 1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:01.321625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:01.321627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:01.321853 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:01.322062 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:01.322063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:01.322063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:01.322166 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:01.322390 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:01.322394 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:01.322500 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.322591 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.322706 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260807 06:47:01.323536 7368 heartbeater.cc:347] Connected to a master server at 127.11.137.190:40179
I20260807 06:47:01.323654 7368 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:01.323827 7368 heartbeater.cc:511] Master 127.11.137.190:40179 requested a full tablet report, sending...
I20260807 06:47:01.324263 6610 ts_manager.cc:194] Registered new tserver with Master: b41319c2a7cc4b84a4f750ea551e6d12 (127.11.137.131:35191)
I20260807 06:47:01.324592 6610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:44725
I20260807 06:47:01.327024 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:47:01.334282 6672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.328403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.11.137.190:40179)
0807 06:47:01.328470 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.328472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.328600 (+ 128us) server_negotiation.cc:407] Connection header received
0807 06:47:01.328663 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.328664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.328675 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.328728 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:01.329323 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.329791 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.330528 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.330721 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.330795 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.331951 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:01.331952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:01.331952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:01.331959 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:01.333381 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.333675 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.333676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.333676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.333727 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:01.333885 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:01.333885 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:01.333885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:01.334011 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:01.334084 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.334166 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.334224 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:47:01.335806 6610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:47:01.337445 6610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:47:01.344206 7389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.339869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40311 (local address 127.0.0.1:46890)
0807 06:47:01.340259 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.340303 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.340379 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.340711 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.340714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.340716 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.340820 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.340823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.341800 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.341801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.342977 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.342980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.343880 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.343881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.343973 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.343987 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.344052 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.344102 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":11,"thread_start_us":56,"threads_started":1}
I20260807 06:47:01.344441 7394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.340076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:46129 (local address 127.0.0.1:50432)
0807 06:47:01.340367 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.340377 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.340446 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.340721 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.340723 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.340725 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.340795 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.340796 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.342181 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.342182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.343200 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.343201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.344211 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.344212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.344278 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.344283 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.344333 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.344374 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":84,"threads_started":1}
I20260807 06:47:01.344564 7392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.339983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46890 (local address 127.11.137.130:40311)
0807 06:47:01.340199 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.340203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.340469 (+ 266us) server_negotiation.cc:407] Connection header received
0807 06:47:01.340517 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.340519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.340536 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.340609 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.340919 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.341702 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.343074 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.343782 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.343855 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.343911 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.344438 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.344481 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":99,"threads_started":1}
I20260807 06:47:01.344734 7400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.340191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.11.137.129:46129)
0807 06:47:01.340344 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.340349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.340445 (+ 96us) server_negotiation.cc:407] Connection header received
0807 06:47:01.340526 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.340529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.340544 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.340618 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.340885 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.342050 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.343277 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.344047 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.344119 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.344173 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.344609 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.344654 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260807 06:47:01.345407 7390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.339869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:35191 (local address 127.0.0.1:48158)
0807 06:47:01.340279 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.340303 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.340379 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.340711 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.340714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.340718 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.340821 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.340823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.343271 (+ 2448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.343271 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.344119 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.344121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.345129 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.345130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.345206 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.345230 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.345291 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.345333 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":7,"thread_start_us":72,"threads_started":1}
I20260807 06:47:01.345422 7038 tablet_service.cc:1467] Processing CreateTablet for tablet 4106bf015bdd403e8754ad7084dc19b6 (DEFAULT_TABLE table=test-table [id=dc6e2422906547dc8efb8938d9e98144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:01.345510 6812 tablet_service.cc:1467] Processing CreateTablet for tablet 4106bf015bdd403e8754ad7084dc19b6 (DEFAULT_TABLE table=test-table [id=dc6e2422906547dc8efb8938d9e98144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:01.345642 7391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.339979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48158 (local address 127.11.137.131:35191)
0807 06:47:01.340193 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.340199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.340477 (+ 278us) server_negotiation.cc:407] Connection header received
0807 06:47:01.340516 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.340519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.340536 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.340629 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.340932 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.342050 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.344207 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.344955 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.345024 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.345093 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.345521 (+ 428us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.345571 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":105,"threads_started":1}
I20260807 06:47:01.345804 6812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4106bf015bdd403e8754ad7084dc19b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:01.345804 7038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4106bf015bdd403e8754ad7084dc19b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:01.349246 7402 tablet_bootstrap.cc:492] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Bootstrap starting.
I20260807 06:47:01.349850 7256 tablet_service.cc:1467] Processing CreateTablet for tablet 4106bf015bdd403e8754ad7084dc19b6 (DEFAULT_TABLE table=test-table [id=dc6e2422906547dc8efb8938d9e98144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:01.349996 7402 tablet_bootstrap.cc:654] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:01.350239 7256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4106bf015bdd403e8754ad7084dc19b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:01.350652 7402 log.cc:824] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:01.351023 7401 tablet_bootstrap.cc:492] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: Bootstrap starting.
I20260807 06:47:01.351534 7402 tablet_bootstrap.cc:492] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: No bootstrap required, opened a new log
I20260807 06:47:01.351693 7402 ts_tablet_manager.cc:1397] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:47:01.351758 7401 tablet_bootstrap.cc:654] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:01.352362 7401 log.cc:824] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:01.353258 7401 tablet_bootstrap.cc:492] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: No bootstrap required, opened a new log
I20260807 06:47:01.353329 7401 ts_tablet_manager.cc:1397] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:01.353582 7402 raft_consensus.cc:348] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.353757 7402 raft_consensus.cc:374] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:01.353822 7402 raft_consensus.cc:729] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4ed859c2f1842fb9af0d7770a5edd86, State: Initialized, Role: FOLLOWER
I20260807 06:47:01.353973 7409 tablet_bootstrap.cc:492] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Bootstrap starting.
I20260807 06:47:01.354043 7402 consensus_queue.cc:260] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.354377 7402 ts_tablet_manager.cc:1428] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:47:01.354576 7148 heartbeater.cc:503] Master 127.11.137.190:40179 was elected leader, sending a full tablet report...
I20260807 06:47:01.354748 7409 tablet_bootstrap.cc:654] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:01.355306 7409 log.cc:824] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:01.355911 7401 raft_consensus.cc:348] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.356063 7409 tablet_bootstrap.cc:492] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: No bootstrap required, opened a new log
I20260807 06:47:01.356070 7401 raft_consensus.cc:374] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:01.356108 7409 ts_tablet_manager.cc:1397] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:01.356123 7401 raft_consensus.cc:729] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f607fd7c85c428583dd6ecc3901a5fb, State: Initialized, Role: FOLLOWER
I20260807 06:47:01.356232 7401 consensus_queue.cc:260] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.356500 7401 ts_tablet_manager.cc:1428] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:47:01.356564 6924 heartbeater.cc:503] Master 127.11.137.190:40179 was elected leader, sending a full tablet report...
I20260807 06:47:01.357957 7409 raft_consensus.cc:348] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.358083 7409 raft_consensus.cc:374] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:01.358104 7409 raft_consensus.cc:729] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b41319c2a7cc4b84a4f750ea551e6d12, State: Initialized, Role: FOLLOWER
I20260807 06:47:01.358237 7409 consensus_queue.cc:260] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.358503 7409 ts_tablet_manager.cc:1428] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:47:01.358501 7368 heartbeater.cc:503] Master 127.11.137.190:40179 was elected leader, sending a full tablet report...
W20260807 06:47:01.407145 7149 tablet.cc:2369] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:47:01.504314 6925 tablet.cc:2369] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:47:01.564070 7369 tablet.cc:2369] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:47:01.608845 7410 raft_consensus.cc:482] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:01.609040 7410 raft_consensus.cc:504] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.609480 7410 leader_election.cc:288] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b41319c2a7cc4b84a4f750ea551e6d12 (127.11.137.131:35191), 9f607fd7c85c428583dd6ecc3901a5fb (127.11.137.129:46129)
I20260807 06:47:01.610301 7416 raft_consensus.cc:482] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:01.610416 7416 raft_consensus.cc:504] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.610733 7416 leader_election.cc:288] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4ed859c2f1842fb9af0d7770a5edd86 (127.11.137.130:40311), 9f607fd7c85c428583dd6ecc3901a5fb (127.11.137.129:46129)
I20260807 06:47:01.613267 7150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.609687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:46129 (local address 127.11.137.130:60127)
0807 06:47:01.609759 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.609773 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.609842 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.610014 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.610015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.610017 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.610118 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.610120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.610961 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.610962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.612214 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.612217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.612969 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.612970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.613051 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.613055 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.613116 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.613162 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 06:47:01.613530 7391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.609852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:33437 (local address 127.11.137.131:35191)
0807 06:47:01.609902 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.609905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.609988 (+ 83us) server_negotiation.cc:407] Connection header received
0807 06:47:01.610091 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.610092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.610101 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.610284 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.610493 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.611124 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.612526 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.613119 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.613177 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.613185 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.613413 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.613463 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":29}
I20260807 06:47:01.613610 7400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.609799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:60127 (local address 127.11.137.129:46129)
0807 06:47:01.609841 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.609843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.609854 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:47:01.609913 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.609914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.609928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.609993 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.610200 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.610886 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.612321 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.612859 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.612928 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.612936 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.613504 (+ 568us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.613544 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:47:01.613741 7417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.609689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:35191 (local address 127.11.137.130:33437)
0807 06:47:01.609895 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.609905 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.610005 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.610301 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.610302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.610303 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.610409 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.610411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.611203 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.611204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.612431 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.612435 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.613245 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.613246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.613315 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.613320 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.613613 (+ 293us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.613659 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":15,"thread_start_us":122,"threads_started":1}
I20260807 06:47:01.613894 6847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" is_pre_election: true
I20260807 06:47:01.614034 6847 raft_consensus.cc:2454] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4ed859c2f1842fb9af0d7770a5edd86 in term 0.
I20260807 06:47:01.614003 7296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" is_pre_election: true
I20260807 06:47:01.614120 7296 raft_consensus.cc:2454] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4ed859c2f1842fb9af0d7770a5edd86 in term 0.
I20260807 06:47:01.614265 6961 leader_election.cc:302] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f607fd7c85c428583dd6ecc3901a5fb, c4ed859c2f1842fb9af0d7770a5edd86; no voters:
I20260807 06:47:01.614701 7371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.610873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40311 (local address 127.11.137.131:55279)
0807 06:47:01.611040 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.611051 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.611086 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.611440 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.611441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.611443 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.611497 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.611499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.612320 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.612321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.613637 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.613640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.614486 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.614487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.614548 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.614550 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.614595 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.614626 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":99}
I20260807 06:47:01.614701 7418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.610954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:46129 (local address 127.11.137.131:48169)
0807 06:47:01.611253 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.611263 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:01.611302 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:01.611517 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:01.611518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:01.611519 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:01.611577 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.611579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.612526 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.612527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.613695 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:01.613697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.614444 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.614445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:01.614515 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.614518 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:01.614568 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 06:47:01.614611 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":3,"thread_start_us":108,"threads_started":1}
I20260807 06:47:01.614821 7410 raft_consensus.cc:2781] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:01.614880 7410 raft_consensus.cc:482] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:01.614867 7419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.611159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:48169 (local address 127.11.137.129:46129)
0807 06:47:01.611396 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.611398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.611406 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:47:01.611427 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.611427 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.611436 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.611638 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.611682 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.612422 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.613784 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.614332 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.614440 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.614447 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.614733 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.614775 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":72,"threads_started":1}
I20260807 06:47:01.614908 7410 raft_consensus.cc:3037] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:01.615093 6847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" is_pre_election: true
I20260807 06:47:01.615177 6847 raft_consensus.cc:2454] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b41319c2a7cc4b84a4f750ea551e6d12 in term 0.
I20260807 06:47:01.615224 7392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.611269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:55279 (local address 127.11.137.130:40311)
0807 06:47:01.611311 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.611313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.611319 (+ 6us) server_negotiation.cc:407] Connection header received
0807 06:47:01.611340 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.611340 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.611348 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.611400 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:01.611560 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.612231 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.613908 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.614401 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.614474 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.614483 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.615124 (+ 641us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.615163 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:47:01.615379 7195 leader_election.cc:302] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f607fd7c85c428583dd6ecc3901a5fb, b41319c2a7cc4b84a4f750ea551e6d12; no voters:
I20260807 06:47:01.615461 7075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" is_pre_election: true
I20260807 06:47:01.615518 7416 raft_consensus.cc:2781] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:01.615561 7416 raft_consensus.cc:482] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:01.615588 7416 raft_consensus.cc:3037] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:01.616216 7410 raft_consensus.cc:504] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.616376 7075 raft_consensus.cc:2379] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b41319c2a7cc4b84a4f750ea551e6d12 in current term 1: Already voted for candidate c4ed859c2f1842fb9af0d7770a5edd86 in this term.
I20260807 06:47:01.616441 7410 leader_election.cc:288] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [CANDIDATE]: Term 1 election: Requested vote from peers b41319c2a7cc4b84a4f750ea551e6d12 (127.11.137.131:35191), 9f607fd7c85c428583dd6ecc3901a5fb (127.11.137.129:46129)
I20260807 06:47:01.616453 7416 raft_consensus.cc:504] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.616479 7296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b41319c2a7cc4b84a4f750ea551e6d12"
I20260807 06:47:01.616562 7296 raft_consensus.cc:2379] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4ed859c2f1842fb9af0d7770a5edd86 in current term 1: Already voted for candidate b41319c2a7cc4b84a4f750ea551e6d12 in this term.
I20260807 06:47:01.616641 6847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f607fd7c85c428583dd6ecc3901a5fb"
I20260807 06:47:01.616720 6847 raft_consensus.cc:3037] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:01.616796 7416 leader_election.cc:288] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [CANDIDATE]: Term 1 election: Requested vote from peers c4ed859c2f1842fb9af0d7770a5edd86 (127.11.137.130:40311), 9f607fd7c85c428583dd6ecc3901a5fb (127.11.137.129:46129)
I20260807 06:47:01.616918 6843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f607fd7c85c428583dd6ecc3901a5fb"
I20260807 06:47:01.617274 7075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4106bf015bdd403e8754ad7084dc19b6" candidate_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4ed859c2f1842fb9af0d7770a5edd86"
I20260807 06:47:01.617344 7075 raft_consensus.cc:2379] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b41319c2a7cc4b84a4f750ea551e6d12 in current term 1: Already voted for candidate c4ed859c2f1842fb9af0d7770a5edd86 in this term.
I20260807 06:47:01.617507 7195 leader_election.cc:302] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b41319c2a7cc4b84a4f750ea551e6d12; no voters: 9f607fd7c85c428583dd6ecc3901a5fb, c4ed859c2f1842fb9af0d7770a5edd86
I20260807 06:47:01.617654 7416 raft_consensus.cc:2726] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 06:47:01.617655 6847 raft_consensus.cc:2454] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4ed859c2f1842fb9af0d7770a5edd86 in term 1.
I20260807 06:47:01.617803 6961 leader_election.cc:302] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f607fd7c85c428583dd6ecc3901a5fb, c4ed859c2f1842fb9af0d7770a5edd86; no voters: b41319c2a7cc4b84a4f750ea551e6d12
I20260807 06:47:01.617926 7410 raft_consensus.cc:2781] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:01.618055 7410 raft_consensus.cc:686] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 LEADER]: Becoming Leader. State: Replica: c4ed859c2f1842fb9af0d7770a5edd86, State: Running, Role: LEADER
I20260807 06:47:01.618258 7410 consensus_queue.cc:237] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } }
I20260807 06:47:01.619138 6608 catalog_manager.cc:5495] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4ed859c2f1842fb9af0d7770a5edd86 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4ed859c2f1842fb9af0d7770a5edd86" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 } health_report { overall_health: UNKNOWN } } }
I20260807 06:47:01.625509 7392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.623317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.11.137.130:40311)
0807 06:47:01.623356 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.623358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.623366 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:47:01.623422 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.623423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.623436 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.623495 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:01.623615 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.624032 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.624776 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.624944 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.624994 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.625132 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:01.625273 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:01.625364 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.625429 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.625445 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 06:47:01.627053 6847 raft_consensus.cc:1261] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 1 FOLLOWER]: Refusing update from remote peer c4ed859c2f1842fb9af0d7770a5edd86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:01.627065 7296 raft_consensus.cc:1261] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 1 FOLLOWER]: Refusing update from remote peer c4ed859c2f1842fb9af0d7770a5edd86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:01.627314 7410 consensus_queue.cc:1035] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f607fd7c85c428583dd6ecc3901a5fb" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:01.627439 7422 consensus_queue.cc:1035] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b41319c2a7cc4b84a4f750ea551e6d12" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:01.629637 7425 mvcc.cc:205] Tried to move back new op lower bound from 7315805067781939200 to 7315805067748900864. Current Snapshot: MvccSnapshot[applied={T|T < 7315805067781939200}]
I20260807 06:47:01.629876 7429 mvcc.cc:205] Tried to move back new op lower bound from 7315805067781939200 to 7315805067748900864. Current Snapshot: MvccSnapshot[applied={T|T < 7315805067781939200}]
I20260807 06:47:01.629908 7430 mvcc.cc:205] Tried to move back new op lower bound from 7315805067781939200 to 7315805067748900864. Current Snapshot: MvccSnapshot[applied={T|T < 7315805067781939200}]
I20260807 06:47:01.632131 6610 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:01.632216 6610 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:01.632975 6610 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 209a8055b676424abc76e8c15a6ce8e9: Sending DeleteTablet for 3 replicas of tablet 4106bf015bdd403e8754ad7084dc19b6
I20260807 06:47:01.633335 7256 tablet_service.cc:1514] Processing DeleteTablet for tablet 4106bf015bdd403e8754ad7084dc19b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:01 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:48158
I20260807 06:47:01.633404 6812 tablet_service.cc:1514] Processing DeleteTablet for tablet 4106bf015bdd403e8754ad7084dc19b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:01 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:50432
I20260807 06:47:01.633492 7038 tablet_service.cc:1514] Processing DeleteTablet for tablet 4106bf015bdd403e8754ad7084dc19b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:01 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:46890
I20260807 06:47:01.633699 7446 tablet_replica.cc:330] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: stopping tablet replica
I20260807 06:47:01.633821 7445 tablet_replica.cc:330] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb: stopping tablet replica
I20260807 06:47:01.633849 7446 raft_consensus.cc:2229] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:47:01.633955 7446 raft_consensus.cc:2258] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:01.633991 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 6712
I20260807 06:47:01.634006 7445 raft_consensus.cc:2229] T 4106bf015bdd403e8754ad7084dc19b6 P 9f607fd7c85c428583dd6ecc3901a5fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:01.637113 7446 ts_tablet_manager.cc:1905] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:01.638945 7446 ts_tablet_manager.cc:1918] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:01.639014 7446 log.cc:1196] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/4106bf015bdd403e8754ad7084dc19b6
I20260807 06:47:01.639292 7446 ts_tablet_manager.cc:1939] T 4106bf015bdd403e8754ad7084dc19b6 P c4ed859c2f1842fb9af0d7770a5edd86: Deleting consensus metadata
I20260807 06:47:01.648015 7443 tablet_replica.cc:330] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: stopping tablet replica
I20260807 06:47:01.648279 7443 raft_consensus.cc:2229] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:01.648382 6592 catalog_manager.cc:4841] TS c4ed859c2f1842fb9af0d7770a5edd86 (127.11.137.130:40311): tablet 4106bf015bdd403e8754ad7084dc19b6 (table test-table [id=dc6e2422906547dc8efb8938d9e98144]) successfully deleted
I20260807 06:47:01.648465 7443 raft_consensus.cc:2258] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:01.648943 7443 ts_tablet_manager.cc:1905] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:01.650753 7443 ts_tablet_manager.cc:1918] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:01.650825 7443 log.cc:1196] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/4106bf015bdd403e8754ad7084dc19b6
I20260807 06:47:01.651178 7443 ts_tablet_manager.cc:1939] T 4106bf015bdd403e8754ad7084dc19b6 P b41319c2a7cc4b84a4f750ea551e6d12: Deleting consensus metadata
I20260807 06:47:01.651638 6591 catalog_manager.cc:4841] TS b41319c2a7cc4b84a4f750ea551e6d12 (127.11.137.131:35191): tablet 4106bf015bdd403e8754ad7084dc19b6 (table test-table [id=dc6e2422906547dc8efb8938d9e98144]) successfully deleted
W20260807 06:47:01.653231 6592 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:46129 (error 108)
I20260807 06:47:01.653540 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 6935
I20260807 06:47:01.656805 7390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.653639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:46129 (local address 127.0.0.1:50436)
0807 06:47:01.656699 (+ 3060us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:01.656759 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3033}
W20260807 06:47:01.660070 6592 catalog_manager.cc:4584] TS 9f607fd7c85c428583dd6ecc3901a5fb (127.11.137.129:46129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4106bf015bdd403e8754ad7084dc19b6: Network error: Client connection negotiation failed: client connection to 127.11.137.129:46129: connect: Connection refused (error 111)
I20260807 06:47:01.666409 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 7161
I20260807 06:47:01.680630 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 6556
2026-08-07T06:47:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2412 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T06:47:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:01Z Disabled control of system clock
I20260807 06:47:01.717501 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45975
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:35225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:45975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:01.800004 7454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:01.800241 7454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:01.800262 7454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:01.801419 7454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:01.801457 7454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:01.801470 7454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:01.801482 7454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:01.801494 7454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:01.802781 7454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:35225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:45975
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:45975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:01.802973 7454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:01.803193 7454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:01.808000 7464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.808034 7467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.808039 7469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:01.808274 7454 server_base.cc:1034] running on GCE node
I20260807 06:47:01.808519 7454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:01.808804 7454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:01.809939 7454 hybrid_clock.cc:648] HybridClock initialized: now 1786085221809927 us; error 27 us; skew 500 ppm
I20260807 06:47:01.811162 7454 webserver.cc:460] Webserver started at http://127.11.137.190:36327/ using document root <none> and password file <none>
I20260807 06:47:01.811453 7454 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:01.811519 7454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:01.811704 7454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:01.812748 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "a3ff941c30c9460782c72c3a082cc04b"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "4cebaf6b193975a8eba68dcecf8f91bf"
server_key_iv: "9521bbd2fda5d7665c174a76fbbdbfdd"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.813119 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "a3ff941c30c9460782c72c3a082cc04b"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "4cebaf6b193975a8eba68dcecf8f91bf"
server_key_iv: "9521bbd2fda5d7665c174a76fbbdbfdd"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.814495 7454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:01.815253 7475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.815441 7454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:01.815516 7454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "a3ff941c30c9460782c72c3a082cc04b"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "4cebaf6b193975a8eba68dcecf8f91bf"
server_key_iv: "9521bbd2fda5d7665c174a76fbbdbfdd"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.815606 7454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:01.829475 7454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:01.829770 7454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:01.829916 7454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:01.833973 7454 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:45975
I20260807 06:47:01.834007 7559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:45975 every 8 connection(s)
I20260807 06:47:01.834352 7454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:01.835320 7561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:01.837606 7561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b: Bootstrap starting.
I20260807 06:47:01.838208 7561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:01.838518 7561 log.cc:824] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:01.839224 7561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b: No bootstrap required, opened a new log
I20260807 06:47:01.840845 7561 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ff941c30c9460782c72c3a082cc04b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45975 } }
I20260807 06:47:01.840986 7561 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:01.841008 7561 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ff941c30c9460782c72c3a082cc04b, State: Initialized, Role: FOLLOWER
I20260807 06:47:01.841190 7561 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ff941c30c9460782c72c3a082cc04b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45975 } }
I20260807 06:47:01.841289 7561 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:01.841311 7561 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:01.841391 7561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:01.841981 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 7454
I20260807 06:47:01.841981 7561 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ff941c30c9460782c72c3a082cc04b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45975 } }
I20260807 06:47:01.842085 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:01.842101 7561 leader_election.cc:302] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3ff941c30c9460782c72c3a082cc04b; no voters:
I20260807 06:47:01.842296 7561 leader_election.cc:288] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:01.842307 11814 external_mini_cluster.cc:1428] Setting key 66c1854133135f82c18ca7e4e5a5bb95
I20260807 06:47:01.842361 7565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:01.842532 7565 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [term 1 LEADER]: Becoming Leader. State: Replica: a3ff941c30c9460782c72c3a082cc04b, State: Running, Role: LEADER
I20260807 06:47:01.842571 7561 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:01.842676 7565 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ff941c30c9460782c72c3a082cc04b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45975 } }
I20260807 06:47:01.843102 7570 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3ff941c30c9460782c72c3a082cc04b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ff941c30c9460782c72c3a082cc04b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45975 } } }
I20260807 06:47:01.843199 7571 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3ff941c30c9460782c72c3a082cc04b. Latest consensus state: current_term: 1 leader_uuid: "a3ff941c30c9460782c72c3a082cc04b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ff941c30c9460782c72c3a082cc04b" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 45975 } } }
I20260807 06:47:01.843283 7570 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:01.843365 7571 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:01.843559 7592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:01.844136 7592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:01.845799 7592 catalog_manager.cc:1347] Generated new cluster ID: b609bf976f8042f0ac0f91f27d9ad94a
I20260807 06:47:01.845872 7592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:01.849951 7574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:01.842777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54840 (local address 127.11.137.190:45975)
0807 06:47:01.843498 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:01.843508 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:01.844320 (+ 812us) server_negotiation.cc:407] Connection header received
0807 06:47:01.844805 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:01.844813 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:01.844889 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:01.845045 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:01.845310 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.846625 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.847719 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:01.848355 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:01.848484 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:01.849190 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:01.849193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:01.849194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:01.849424 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:01.849465 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:01.849481 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:01.849554 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:01.849647 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 06:47:01.849730 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":72,"threads_started":1}
I20260807 06:47:01.857550 7592 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:01.858219 7592 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:01.869071 7592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b: Generated new TSK 0
I20260807 06:47:01.869297 7592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:01.870491 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45975
--builtin_ntp_servers=127.11.137.148:35225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:01.954387 7610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:01.954622 7610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:01.954658 7610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:01.955766 7610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:01.955830 7610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:01.955873 7610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:47:01.957340 7610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:35225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:01.957587 7610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:01.957888 7610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:01.963011 7623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.963013 7621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:01.963045 7627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:01.963418 7610 server_base.cc:1034] running on GCE node
I20260807 06:47:01.963719 7610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:01.963995 7610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:01.965164 7610 hybrid_clock.cc:648] HybridClock initialized: now 1786085221965153 us; error 34 us; skew 500 ppm
I20260807 06:47:01.966514 7610 webserver.cc:460] Webserver started at http://127.11.137.129:41959/ using document root <none> and password file <none>
I20260807 06:47:01.966794 7610 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:01.966881 7610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:01.967036 7610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:01.968097 7610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "72a1f67aca0a4ac0bc2a9899c309c127"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "8f4d2d0db9e3d1c7de3a195fd1123913"
server_key_iv: "2434f36e58780b762032ebc005e4d9f1"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.968498 7610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "72a1f67aca0a4ac0bc2a9899c309c127"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "8f4d2d0db9e3d1c7de3a195fd1123913"
server_key_iv: "2434f36e58780b762032ebc005e4d9f1"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.970048 7610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 06:47:01.970878 7637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:01.971073 7610 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:01.971161 7610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "72a1f67aca0a4ac0bc2a9899c309c127"
format_stamp: "Formatted at 2026-08-07 06:47:01 on dist-test-slave-8hhm"
server_key: "8f4d2d0db9e3d1c7de3a195fd1123913"
server_key_iv: "2434f36e58780b762032ebc005e4d9f1"
server_key_version: "encryptionkey@0"
I20260807 06:47:01.971264 7610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:02.002285 7610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:02.002635 7610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:02.002821 7610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:02.003079 7610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:02.003453 7610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:02.003511 7610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.003553 7610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:02.003597 7610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.009930 7610 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:46863
I20260807 06:47:02.010002 7821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:46863 every 8 connection(s)
I20260807 06:47:02.010363 7610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:47:02.015394 7574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.011131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:53971 (local address 127.11.137.190:45975)
0807 06:47:02.011220 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.011222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.011455 (+ 233us) server_negotiation.cc:407] Connection header received
0807 06:47:02.011973 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.011975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.011988 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.012044 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:02.012690 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.013188 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.014164 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.014347 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.014399 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.015162 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:02.015163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:02.015163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:02.015167 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:02.015181 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:02.015185 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:02.015229 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.015312 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.015336 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:47:02.015576 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.011104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45975 (local address 127.11.137.129:53971)
0807 06:47:02.011331 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.011367 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.011889 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.012099 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.012102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.012111 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:02.012617 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.012621 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.013307 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.013308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.014088 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.014091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.014422 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.014423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.014550 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.015035 (+ 485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:02.015035 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:02.015063 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:02.015084 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:02.015244 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:02.015248 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:02.015250 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.015302 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.015379 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":117,"threads_started":1}
I20260807 06:47:02.016108 7823 heartbeater.cc:347] Connected to a master server at 127.11.137.190:45975
I20260807 06:47:02.016223 7823 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:02.016414 7823 heartbeater.cc:511] Master 127.11.137.190:45975 requested a full tablet report, sending...
I20260807 06:47:02.016860 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 7610
I20260807 06:47:02.016952 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:47:02.016992 7505 ts_manager.cc:194] Registered new tserver with Master: 72a1f67aca0a4ac0bc2a9899c309c127 (127.11.137.129:46863)
I20260807 06:47:02.017159 11814 external_mini_cluster.cc:1428] Setting key a567072793c9fbedf4103375fb381339
I20260807 06:47:02.017871 7505 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.129:53971
I20260807 06:47:02.018316 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45975
--builtin_ntp_servers=127.11.137.148:35225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:02.102421 7826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:02.102630 7826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:02.102651 7826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:02.103740 7826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:02.103775 7826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:02.103799 7826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:47:02.105072 7826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:35225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:02.105315 7826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:02.105572 7826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:02.110539 7832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:02.110554 7833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:02.110589 7836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:02.110853 7826 server_base.cc:1034] running on GCE node
I20260807 06:47:02.111083 7826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:02.111325 7826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:02.112491 7826 hybrid_clock.cc:648] HybridClock initialized: now 1786085222112481 us; error 42 us; skew 500 ppm
I20260807 06:47:02.113823 7826 webserver.cc:460] Webserver started at http://127.11.137.130:43659/ using document root <none> and password file <none>
I20260807 06:47:02.114065 7826 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:02.114135 7826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:02.114284 7826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:02.115357 7826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "f5e830a23ca3462e95bd22db6a8cb912"
format_stamp: "Formatted at 2026-08-07 06:47:02 on dist-test-slave-8hhm"
server_key: "6500f7f78cae8cdb166917e2e0cdf470"
server_key_iv: "ec5783b132fedb4493beaf94f446308d"
server_key_version: "encryptionkey@0"
I20260807 06:47:02.115731 7826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "f5e830a23ca3462e95bd22db6a8cb912"
format_stamp: "Formatted at 2026-08-07 06:47:02 on dist-test-slave-8hhm"
server_key: "6500f7f78cae8cdb166917e2e0cdf470"
server_key_iv: "ec5783b132fedb4493beaf94f446308d"
server_key_version: "encryptionkey@0"
I20260807 06:47:02.117065 7826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:47:02.117991 7849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.118202 7826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:02.118307 7826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "f5e830a23ca3462e95bd22db6a8cb912"
format_stamp: "Formatted at 2026-08-07 06:47:02 on dist-test-slave-8hhm"
server_key: "6500f7f78cae8cdb166917e2e0cdf470"
server_key_iv: "ec5783b132fedb4493beaf94f446308d"
server_key_version: "encryptionkey@0"
I20260807 06:47:02.118408 7826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:02.130478 7826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:02.130728 7826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:02.130831 7826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:02.131001 7826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:02.131322 7826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:02.131356 7826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.131412 7826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:02.131438 7826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.137588 7826 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:41781
I20260807 06:47:02.137632 8030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:41781 every 8 connection(s)
I20260807 06:47:02.137964 7826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:47:02.143069 7574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.138674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:35469 (local address 127.11.137.190:45975)
0807 06:47:02.138744 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.138746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.139011 (+ 265us) server_negotiation.cc:407] Connection header received
0807 06:47:02.139486 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.139487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.139499 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.139554 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:02.140209 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.140690 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.141742 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.141947 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.142003 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.142791 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:02.142792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:02.142793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:02.142797 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:02.142811 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:02.142833 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:02.142906 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.142984 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.143008 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:47:02.143287 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.138672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45975 (local address 127.11.137.130:35469)
0807 06:47:02.138880 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.138914 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.139396 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.139618 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.139622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.139630 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:02.140126 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.140130 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.140772 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.140773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.141660 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.141663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.142029 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.142030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.142159 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.142658 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:02.142658 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:02.142691 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:02.142713 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:02.142906 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:02.142915 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:02.142918 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.142971 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.143053 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260807 06:47:02.143798 8032 heartbeater.cc:347] Connected to a master server at 127.11.137.190:45975
I20260807 06:47:02.143914 8032 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:02.144124 8032 heartbeater.cc:511] Master 127.11.137.190:45975 requested a full tablet report, sending...
I20260807 06:47:02.144119 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 7826
I20260807 06:47:02.144196 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:47:02.144428 11814 external_mini_cluster.cc:1428] Setting key 4f2adddda684a6f13c433dc8cae7de5a
I20260807 06:47:02.144635 7505 ts_manager.cc:194] Registered new tserver with Master: f5e830a23ca3462e95bd22db6a8cb912 (127.11.137.130:41781)
I20260807 06:47:02.145025 7505 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.130:35469
I20260807 06:47:02.145386 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45975
--builtin_ntp_servers=127.11.137.148:35225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:02.227962 8041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:02.228201 8041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:02.228240 8041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:02.229444 8041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:02.229516 8041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:02.229559 8041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:47:02.231061 8041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:35225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:45975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:02.231340 8041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:02.231652 8041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:02.236765 8049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:02.236846 8041 server_base.cc:1034] running on GCE node
W20260807 06:47:02.236771 8052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:02.236783 8050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:02.237330 8041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:02.237581 8041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:02.238727 8041 hybrid_clock.cc:648] HybridClock initialized: now 1786085222238718 us; error 31 us; skew 500 ppm
I20260807 06:47:02.240044 8041 webserver.cc:460] Webserver started at http://127.11.137.131:37501/ using document root <none> and password file <none>
I20260807 06:47:02.240314 8041 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:02.240361 8041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:02.240535 8041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:02.241750 8041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "be57b6f3d86341bf90fb626c6e5513f6"
format_stamp: "Formatted at 2026-08-07 06:47:02 on dist-test-slave-8hhm"
server_key: "b71df5d4403e99bcf2bbdaca7f177459"
server_key_iv: "5871912cac01ff33bdde264e3a360367"
server_key_version: "encryptionkey@0"
I20260807 06:47:02.242144 8041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "be57b6f3d86341bf90fb626c6e5513f6"
format_stamp: "Formatted at 2026-08-07 06:47:02 on dist-test-slave-8hhm"
server_key: "b71df5d4403e99bcf2bbdaca7f177459"
server_key_iv: "5871912cac01ff33bdde264e3a360367"
server_key_version: "encryptionkey@0"
I20260807 06:47:02.243585 8041 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:02.244367 8059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.244556 8041 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:02.244659 8041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "be57b6f3d86341bf90fb626c6e5513f6"
format_stamp: "Formatted at 2026-08-07 06:47:02 on dist-test-slave-8hhm"
server_key: "b71df5d4403e99bcf2bbdaca7f177459"
server_key_iv: "5871912cac01ff33bdde264e3a360367"
server_key_version: "encryptionkey@0"
I20260807 06:47:02.244757 8041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:02.268499 8041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:02.268867 8041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:02.269032 8041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:02.269343 8041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:02.269737 8041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:02.269794 8041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.269831 8041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:02.269857 8041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:02.275950 8041 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:43865
I20260807 06:47:02.275995 8242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:43865 every 8 connection(s)
I20260807 06:47:02.276352 8041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:47:02.281275 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 8041
I20260807 06:47:02.281379 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:47:02.281594 11814 external_mini_cluster.cc:1428] Setting key 9d37dffe6a14b396d891f0e0553d5e73
I20260807 06:47:02.281657 7574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.277152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:59971 (local address 127.11.137.190:45975)
0807 06:47:02.277241 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.277243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.277515 (+ 272us) server_negotiation.cc:407] Connection header received
0807 06:47:02.278004 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.278005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.278016 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.278065 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:02.278712 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.279186 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.280157 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.280346 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.280396 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.281334 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:02.281335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:02.281335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:02.281340 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:02.281355 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:02.281360 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:02.281413 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.281544 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.281576 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:47:02.281881 8245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.277145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:45975 (local address 127.11.137.131:59971)
0807 06:47:02.277385 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.277420 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.277917 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.278129 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.278132 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.278140 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:02.278640 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.278644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.279289 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.279290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.280067 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.280069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.280423 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.280424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.280531 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.281125 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:02.281125 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:02.281167 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:02.281244 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:02.281444 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:02.281451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:02.281454 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.281547 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.281649 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":135,"threads_started":1}
I20260807 06:47:02.282581 8243 heartbeater.cc:347] Connected to a master server at 127.11.137.190:45975
I20260807 06:47:02.282698 8243 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:02.282886 8243 heartbeater.cc:511] Master 127.11.137.190:45975 requested a full tablet report, sending...
I20260807 06:47:02.283258 7505 ts_manager.cc:194] Registered new tserver with Master: be57b6f3d86341bf90fb626c6e5513f6 (127.11.137.131:43865)
I20260807 06:47:02.283582 7505 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.131:59971
I20260807 06:47:02.293849 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:47:02.298427 7574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.295280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54848 (local address 127.11.137.190:45975)
0807 06:47:02.295364 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.295367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.295465 (+ 98us) server_negotiation.cc:407] Connection header received
0807 06:47:02.295569 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.295570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.295585 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.295654 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:02.295849 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.296337 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.297103 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.297319 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.297403 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.298150 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:02.298151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:02.298151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:02.298156 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:02.298171 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:02.298177 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:02.298246 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.298308 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.298335 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:47:02.299942 7505 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:47:02.301548 7505 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:47:02.308403 8261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.304251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39908 (local address 127.11.137.129:46863)
0807 06:47:02.304478 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.304483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.304765 (+ 282us) server_negotiation.cc:407] Connection header received
0807 06:47:02.304813 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.304815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.304830 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.304908 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:02.305010 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.305781 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.307249 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.307991 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.308075 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.308172 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.308260 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.308304 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
I20260807 06:47:02.308405 8254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.303887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:43865 (local address 127.0.0.1:42336)
0807 06:47:02.304055 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.304101 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.304173 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.304669 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.304674 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.304676 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:02.304769 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.304770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.306119 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.306119 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.307166 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.307168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.308089 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.308090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.308190 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.308195 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.308233 (+ 38us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.308309 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":3,"thread_start_us":75,"threads_started":1}
I20260807 06:47:02.308411 8253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.304127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:46863 (local address 127.0.0.1:39908)
0807 06:47:02.304483 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.304495 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.304559 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.304905 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.304906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.304908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:02.304953 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.304954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.305867 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.305868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.307153 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.307156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.308072 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.308072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.308152 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.308167 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.308233 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.308313 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":29,"thread_start_us":90,"threads_started":1}
I20260807 06:47:02.308835 8258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.304007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.11.137.131:43865)
0807 06:47:02.304478 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.304483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.304497 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:47:02.304541 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.304543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.304559 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.304852 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:02.304912 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.306036 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.307248 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.307991 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.308536 (+ 545us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.308638 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.308670 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.308722 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":128,"threads_started":1}
I20260807 06:47:02.309372 8259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.303887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:41781 (local address 127.0.0.1:53468)
0807 06:47:02.304260 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.304269 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.304307 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.304668 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.304677 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.304679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:02.304772 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.304773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.307257 (+ 2484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.307258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.307911 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.307912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.309147 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.309148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.309242 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.309247 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.309279 (+ 32us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.309318 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":32,"thread_start_us":96,"threads_started":1}
I20260807 06:47:02.309510 8138 tablet_service.cc:1467] Processing CreateTablet for tablet 5c79841c0e654461b0692a7803643855 (DEFAULT_TABLE table=test-table [id=783c73d096aa48c1aadeafe2896fc462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:02.309510 7713 tablet_service.cc:1467] Processing CreateTablet for tablet 5c79841c0e654461b0692a7803643855 (DEFAULT_TABLE table=test-table [id=783c73d096aa48c1aadeafe2896fc462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:02.309777 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.304296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.11.137.130:41781)
0807 06:47:02.304478 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.304483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.304495 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:47:02.304556 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.304558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.304575 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.304660 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:02.304859 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.306029 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.308004 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.309032 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.309500 (+ 468us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.309597 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.309622 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.309668 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260807 06:47:02.309897 7713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c79841c0e654461b0692a7803643855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:02.309897 8138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c79841c0e654461b0692a7803643855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:02.313954 8267 tablet_bootstrap.cc:492] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127: Bootstrap starting.
I20260807 06:47:02.314255 7918 tablet_service.cc:1467] Processing CreateTablet for tablet 5c79841c0e654461b0692a7803643855 (DEFAULT_TABLE table=test-table [id=783c73d096aa48c1aadeafe2896fc462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:02.314612 8267 tablet_bootstrap.cc:654] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:02.314627 7918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c79841c0e654461b0692a7803643855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:02.314935 8267 log.cc:824] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:02.315685 8268 tablet_bootstrap.cc:492] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Bootstrap starting.
I20260807 06:47:02.316201 8267 tablet_bootstrap.cc:492] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127: No bootstrap required, opened a new log
I20260807 06:47:02.316277 8267 ts_tablet_manager.cc:1397] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:02.316303 8268 tablet_bootstrap.cc:654] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:02.316574 8268 log.cc:824] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:02.317338 8268 tablet_bootstrap.cc:492] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: No bootstrap required, opened a new log
I20260807 06:47:02.317407 8268 ts_tablet_manager.cc:1397] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:47:02.318323 8272 tablet_bootstrap.cc:492] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Bootstrap starting.
I20260807 06:47:02.318846 8267 raft_consensus.cc:348] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.319046 8272 tablet_bootstrap.cc:654] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:02.319063 8267 raft_consensus.cc:374] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:02.319114 8267 raft_consensus.cc:729] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a1f67aca0a4ac0bc2a9899c309c127, State: Initialized, Role: FOLLOWER
I20260807 06:47:02.319247 8267 consensus_queue.cc:260] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.319368 8272 log.cc:824] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:02.319509 8267 ts_tablet_manager.cc:1428] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 06:47:02.319694 7823 heartbeater.cc:503] Master 127.11.137.190:45975 was elected leader, sending a full tablet report...
I20260807 06:47:02.320652 8268 raft_consensus.cc:348] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.320839 8268 raft_consensus.cc:374] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:02.320902 8268 raft_consensus.cc:729] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be57b6f3d86341bf90fb626c6e5513f6, State: Initialized, Role: FOLLOWER
I20260807 06:47:02.321017 8268 consensus_queue.cc:260] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.321362 8268 ts_tablet_manager.cc:1428] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260807 06:47:02.321419 8243 heartbeater.cc:503] Master 127.11.137.190:45975 was elected leader, sending a full tablet report...
I20260807 06:47:02.322170 8272 tablet_bootstrap.cc:492] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: No bootstrap required, opened a new log
I20260807 06:47:02.322291 8272 ts_tablet_manager.cc:1397] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 06:47:02.324016 8272 raft_consensus.cc:348] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.324169 8272 raft_consensus.cc:374] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:02.324218 8272 raft_consensus.cc:729] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e830a23ca3462e95bd22db6a8cb912, State: Initialized, Role: FOLLOWER
I20260807 06:47:02.324321 8272 consensus_queue.cc:260] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.324564 8272 ts_tablet_manager.cc:1428] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:02.324636 8032 heartbeater.cc:503] Master 127.11.137.190:45975 was elected leader, sending a full tablet report...
W20260807 06:47:02.388576 8035 tablet.cc:2369] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:47:02.453733 8274 raft_consensus.cc:482] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:02.453862 8274 raft_consensus.cc:504] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.454341 8274 leader_election.cc:288] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e830a23ca3462e95bd22db6a8cb912 (127.11.137.130:41781), be57b6f3d86341bf90fb626c6e5513f6 (127.11.137.131:43865)
I20260807 06:47:02.457171 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.454503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:41781 (local address 127.11.137.129:41221)
0807 06:47:02.454577 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.454590 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.454636 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.454843 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.454844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.454846 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:02.454918 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.454920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.455593 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.455594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.456356 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.456358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.456896 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.456897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.456974 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.456977 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.457053 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.457097 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":5}
I20260807 06:47:02.457297 8279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.454541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:43865 (local address 127.11.137.129:36737)
0807 06:47:02.454750 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.454760 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:02.454835 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:02.454994 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:02.454995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:02.454997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:02.455076 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.455077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.455703 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.455705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.456438 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:02.456440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.456978 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.456979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:02.457068 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.457072 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:02.457140 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:47:02.457180 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":120,"threads_started":1}
I20260807 06:47:02.457180 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.454615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:41221 (local address 127.11.137.130:41781)
0807 06:47:02.454697 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.454699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.454710 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:47:02.454747 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.454748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.454759 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.454836 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:02.455006 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.455500 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.456456 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.456810 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.456896 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.456904 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.457061 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.457097 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:47:02.457608 8258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.454681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:36737 (local address 127.11.137.131:43865)
0807 06:47:02.454727 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.454729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.454831 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:47:02.454905 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.454908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.454921 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.454987 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:02.455152 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.455613 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.456534 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.456886 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.456975 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.456982 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.457148 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.457186 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:47:02.457705 7952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c79841c0e654461b0692a7803643855" candidate_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e830a23ca3462e95bd22db6a8cb912" is_pre_election: true
I20260807 06:47:02.457890 7952 raft_consensus.cc:2454] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1f67aca0a4ac0bc2a9899c309c127 in term 0.
I20260807 06:47:02.457954 8168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c79841c0e654461b0692a7803643855" candidate_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be57b6f3d86341bf90fb626c6e5513f6" is_pre_election: true
I20260807 06:47:02.458137 8168 raft_consensus.cc:2454] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1f67aca0a4ac0bc2a9899c309c127 in term 0.
I20260807 06:47:02.458163 7643 leader_election.cc:302] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1f67aca0a4ac0bc2a9899c309c127, f5e830a23ca3462e95bd22db6a8cb912; no voters:
I20260807 06:47:02.458274 8274 raft_consensus.cc:2781] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:02.458328 8274 raft_consensus.cc:482] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:02.458349 8274 raft_consensus.cc:3037] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:02.459092 8274 raft_consensus.cc:504] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.459249 8274 leader_election.cc:288] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [CANDIDATE]: Term 1 election: Requested vote from peers f5e830a23ca3462e95bd22db6a8cb912 (127.11.137.130:41781), be57b6f3d86341bf90fb626c6e5513f6 (127.11.137.131:43865)
I20260807 06:47:02.459388 8168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c79841c0e654461b0692a7803643855" candidate_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be57b6f3d86341bf90fb626c6e5513f6"
I20260807 06:47:02.459467 8168 raft_consensus.cc:3037] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:02.460151 8168 raft_consensus.cc:2454] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1f67aca0a4ac0bc2a9899c309c127 in term 1.
I20260807 06:47:02.460278 7952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c79841c0e654461b0692a7803643855" candidate_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e830a23ca3462e95bd22db6a8cb912"
I20260807 06:47:02.460340 7644 leader_election.cc:302] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1f67aca0a4ac0bc2a9899c309c127, be57b6f3d86341bf90fb626c6e5513f6; no voters:
I20260807 06:47:02.460362 7952 raft_consensus.cc:3037] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:02.460453 8274 raft_consensus.cc:2781] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:02.460635 8274 raft_consensus.cc:686] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [term 1 LEADER]: Becoming Leader. State: Replica: 72a1f67aca0a4ac0bc2a9899c309c127, State: Running, Role: LEADER
I20260807 06:47:02.460747 8274 consensus_queue.cc:237] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } }
I20260807 06:47:02.461330 7952 raft_consensus.cc:2454] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1f67aca0a4ac0bc2a9899c309c127 in term 1.
I20260807 06:47:02.461748 7504 catalog_manager.cc:5495] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a1f67aca0a4ac0bc2a9899c309c127 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1f67aca0a4ac0bc2a9899c309c127" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 46863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 } health_report { overall_health: UNKNOWN } } }
I20260807 06:47:02.493997 8261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.491650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39910 (local address 127.11.137.129:46863)
0807 06:47:02.491728 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:02.491730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:02.491739 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:02.491800 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:02.491801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:02.491819 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:02.491881 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:02.492015 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.492473 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.493174 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:02.493420 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:02.493474 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:02.493616 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:02.493748 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:02.493810 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:02.493848 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 06:47:02.493868 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:47:02.495926 8168 raft_consensus.cc:1261] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 1 FOLLOWER]: Refusing update from remote peer 72a1f67aca0a4ac0bc2a9899c309c127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:02.496279 7952 raft_consensus.cc:1261] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 1 FOLLOWER]: Refusing update from remote peer 72a1f67aca0a4ac0bc2a9899c309c127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:02.496290 8274 consensus_queue.cc:1035] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be57b6f3d86341bf90fb626c6e5513f6" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 43865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:02.496628 8274 consensus_queue.cc:1035] T 5c79841c0e654461b0692a7803643855 P 72a1f67aca0a4ac0bc2a9899c309c127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e830a23ca3462e95bd22db6a8cb912" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:02.500039 8286 mvcc.cc:205] Tried to move back new op lower bound from 7315805071340404736 to 7315805071199817728. Current Snapshot: MvccSnapshot[applied={T|T < 7315805071340404736}]
I20260807 06:47:02.500666 8290 mvcc.cc:205] Tried to move back new op lower bound from 7315805071340404736 to 7315805071199817728. Current Snapshot: MvccSnapshot[applied={T|T < 7315805071340404736 or (T in {7315805071340404736})}]
I20260807 06:47:02.503028 7504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:02.503124 7504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:02.503939 7504 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3ff941c30c9460782c72c3a082cc04b: Sending DeleteTablet for 3 replicas of tablet 5c79841c0e654461b0692a7803643855
I20260807 06:47:02.504355 8138 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c79841c0e654461b0692a7803643855 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:02 UTC) from {username='slave'} at 127.0.0.1:42336
I20260807 06:47:02.504591 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 7610
I20260807 06:47:02.504590 7918 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c79841c0e654461b0692a7803643855 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:02 UTC) from {username='slave'} at 127.0.0.1:53468
I20260807 06:47:02.505187 8298 tablet_replica.cc:330] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: stopping tablet replica
I20260807 06:47:02.505335 8298 raft_consensus.cc:2229] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:02.505460 8298 raft_consensus.cc:2258] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:02.505633 8300 tablet_replica.cc:330] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: stopping tablet replica
I20260807 06:47:02.505733 8300 raft_consensus.cc:2229] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:02.505843 8300 raft_consensus.cc:2258] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:02.507635 8298 ts_tablet_manager.cc:1905] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:02.507761 8300 ts_tablet_manager.cc:1905] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:02.509428 8300 ts_tablet_manager.cc:1918] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:02.509505 8300 log.cc:1196] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/5c79841c0e654461b0692a7803643855
I20260807 06:47:02.509671 8298 ts_tablet_manager.cc:1918] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:02.509732 8298 log.cc:1196] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/5c79841c0e654461b0692a7803643855
I20260807 06:47:02.509794 8300 ts_tablet_manager.cc:1939] T 5c79841c0e654461b0692a7803643855 P f5e830a23ca3462e95bd22db6a8cb912: Deleting consensus metadata
I20260807 06:47:02.509938 8298 ts_tablet_manager.cc:1939] T 5c79841c0e654461b0692a7803643855 P be57b6f3d86341bf90fb626c6e5513f6: Deleting consensus metadata
I20260807 06:47:02.510293 7479 catalog_manager.cc:4841] TS f5e830a23ca3462e95bd22db6a8cb912 (127.11.137.130:41781): tablet 5c79841c0e654461b0692a7803643855 (table test-table [id=783c73d096aa48c1aadeafe2896fc462]) successfully deleted
I20260807 06:47:02.511857 7480 catalog_manager.cc:4841] TS be57b6f3d86341bf90fb626c6e5513f6 (127.11.137.131:43865): tablet 5c79841c0e654461b0692a7803643855 (table test-table [id=783c73d096aa48c1aadeafe2896fc462]) successfully deleted
W20260807 06:47:02.519721 7479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:46863 (error 108)
I20260807 06:47:02.519935 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 7826
I20260807 06:47:02.521719 8259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:02.520087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:46863 (local address 127.0.0.1:39912)
0807 06:47:02.521619 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:02.521668 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:46863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1509}
W20260807 06:47:02.521847 7479 catalog_manager.cc:4584] TS 72a1f67aca0a4ac0bc2a9899c309c127 (127.11.137.129:46863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c79841c0e654461b0692a7803643855: Network error: Client connection negotiation failed: client connection to 127.11.137.129:46863: connect: Connection refused (error 111)
I20260807 06:47:02.527320 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 8041
I20260807 06:47:02.537016 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 7454
2026-08-07T06:47:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (848 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:02 dist-test-slave-8hhm krb5kdc[8313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:02 dist-test-slave-8hhm krb5kdc[8313](info): set up 2 sockets
Aug 07 06:47:02 dist-test-slave-8hhm krb5kdc[8313](info): commencing operation
krb5kdc: starting...
W20260807 06:47:03.785046 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:03 dist-test-slave-8hhm krb5kdc[8313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:03.912436 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36415
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:36415
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:03.993702 8337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:03.993956 8337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:03.993993 8337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:03.995138 8337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:03.995213 8337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:03.995236 8337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:03.995256 8337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:03.995286 8337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:03.996779 8337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:36415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:03.997069 8337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:03.997319 8337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:47:04.002358 8337 server_base.cc:1034] running on GCE node
W20260807 06:47:04.002328 8343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.002328 8345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.002312 8342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:04.002986 8337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:04.003259 8337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:04.004431 8337 hybrid_clock.cc:648] HybridClock initialized: now 1786085224004412 us; error 33 us; skew 500 ppm
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:04.007136 8337 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:04.007586 8337 webserver.cc:460] Webserver started at http://127.11.137.190:38925/ using document root <none> and password file <none>
I20260807 06:47:04.007830 8337 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:04.007902 8337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:04.008057 8337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:04.009186 8337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "c4dc305b9e54465b837372aecd65e210"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "31c9c0529caf5a84cea928fe639257e3"
server_key_iv: "9bf0f18ac8597f095e4e50e29e326b17"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.009651 8337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "c4dc305b9e54465b837372aecd65e210"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "31c9c0529caf5a84cea928fe639257e3"
server_key_iv: "9bf0f18ac8597f095e4e50e29e326b17"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.010998 8337 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:04.011752 8353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.011935 8337 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:04.012048 8337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "c4dc305b9e54465b837372aecd65e210"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "31c9c0529caf5a84cea928fe639257e3"
server_key_iv: "9bf0f18ac8597f095e4e50e29e326b17"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.012125 8337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:04.024528 8337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:04.026410 8337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:04.026587 8337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:04.030612 8337 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:36415
I20260807 06:47:04.030664 8456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:36415 every 8 connection(s)
I20260807 06:47:04.031019 8337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:04.031908 8457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:04.034250 8457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210: Bootstrap starting.
I20260807 06:47:04.034845 8457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:04.035146 8457 log.cc:824] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:04.035845 8457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210: No bootstrap required, opened a new log
I20260807 06:47:04.037460 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 8337
I20260807 06:47:04.037575 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:04.037569 8457 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4dc305b9e54465b837372aecd65e210" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36415 } }
I20260807 06:47:04.037771 8457 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:04.037791 11814 external_mini_cluster.cc:1428] Setting key 1be3ea78b68570aee48302d449b87dc9
I20260807 06:47:04.037799 8457 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4dc305b9e54465b837372aecd65e210, State: Initialized, Role: FOLLOWER
I20260807 06:47:04.037962 8457 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4dc305b9e54465b837372aecd65e210" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36415 } }
I20260807 06:47:04.038067 8457 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:04.038117 8457 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:04.038175 8457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:04.039042 8457 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4dc305b9e54465b837372aecd65e210" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36415 } }
I20260807 06:47:04.039161 8457 leader_election.cc:302] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4dc305b9e54465b837372aecd65e210; no voters:
I20260807 06:47:04.039347 8457 leader_election.cc:288] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:04.039390 8464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:04.039495 8464 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [term 1 LEADER]: Becoming Leader. State: Replica: c4dc305b9e54465b837372aecd65e210, State: Running, Role: LEADER
I20260807 06:47:04.039608 8457 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:04.039631 8464 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4dc305b9e54465b837372aecd65e210" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36415 } }
I20260807 06:47:04.039991 8465 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4dc305b9e54465b837372aecd65e210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4dc305b9e54465b837372aecd65e210" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36415 } } }
I20260807 06:47:04.040215 8465 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:04.039979 8464 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4dc305b9e54465b837372aecd65e210. Latest consensus state: current_term: 1 leader_uuid: "c4dc305b9e54465b837372aecd65e210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4dc305b9e54465b837372aecd65e210" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36415 } } }
I20260807 06:47:04.040532 8464 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:04.040712 8474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:04.041320 8474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:04.043040 8474 catalog_manager.cc:1347] Generated new cluster ID: 6f927df10b5d484e864e284784e40535
I20260807 06:47:04.043143 8474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:04.049832 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.038345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.11.137.190:36415)
0807 06:47:04.038531 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.038539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.038571 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:47:04.038683 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.038689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.038728 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.038865 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:04.039631 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.041251 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.042435 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.043003 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.043132 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.045994 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:04.045998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:04.045998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:04.046010 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:04.048060 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.048463 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.048466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.048466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.048591 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.048813 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.048813 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.048814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.049178 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:04.049389 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.049475 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.049621 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260807 06:47:04.067698 8474 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:04.068244 8474 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:04.074522 8474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210: Generated new TSK 0
I20260807 06:47:04.074723 8474 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:47:04.112304 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36415
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:04.217010 8496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:04.217231 8496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:04.217257 8496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:04.218317 8496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:04.218354 8496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:04.218380 8496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:47:04.219784 8496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:04.219976 8496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:04.220146 8496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:04.225121 8504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.225167 8505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.225167 8508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:04.225500 8496 server_base.cc:1034] running on GCE node
I20260807 06:47:04.225728 8496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:04.225986 8496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:04.227156 8496 hybrid_clock.cc:648] HybridClock initialized: now 1786085224227148 us; error 35 us; skew 500 ppm
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:04.229782 8496 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:47:04.230177 8496 webserver.cc:460] Webserver started at http://127.11.137.129:33953/ using document root <none> and password file <none>
I20260807 06:47:04.230371 8496 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:04.230412 8496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:04.230508 8496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:04.231467 8496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "3674ad42410746b882b8e93aabea5a6a"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "d7030960546d3f4a87edbae809504fe6"
server_key_iv: "ab54160e9c9d40f7888c7b032dfc0acc"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.231796 8496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "3674ad42410746b882b8e93aabea5a6a"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "d7030960546d3f4a87edbae809504fe6"
server_key_iv: "ab54160e9c9d40f7888c7b032dfc0acc"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.233050 8496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:47:04.233842 8524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.234015 8496 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.234098 8496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "3674ad42410746b882b8e93aabea5a6a"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "d7030960546d3f4a87edbae809504fe6"
server_key_iv: "ab54160e9c9d40f7888c7b032dfc0acc"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.234154 8496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:04.250964 8496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:04.252882 8496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:04.253012 8496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:04.253206 8496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:04.253604 8496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:04.253639 8496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.253691 8496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:04.253717 8496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.259622 8496 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:44835
I20260807 06:47:04.259704 8699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:44835 every 8 connection(s)
I20260807 06:47:04.260020 8496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:04.269418 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.260783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:53481 (local address 127.11.137.190:36415)
0807 06:47:04.260849 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.260854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.261092 (+ 238us) server_negotiation.cc:407] Connection header received
0807 06:47:04.261660 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.261661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.261680 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.261740 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:04.262721 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.263243 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.264251 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.264463 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.264543 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.266689 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:04.266691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:04.266691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:04.266698 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:04.268160 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.268545 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.268545 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.268546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.268597 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.268808 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.268808 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.268809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.268910 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:04.268960 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.269280 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.269351 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:47:04.269398 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 8496
I20260807 06:47:04.269518 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:47:04.269701 8702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.260731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36415 (local address 127.11.137.129:53481)
0807 06:47:04.260947 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.260985 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.261532 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.261813 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.261817 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.262408 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:04.262612 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.262617 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.263346 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.263347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.264155 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.264157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.264553 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.264554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.264685 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.265170 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:04.265178 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:04.266585 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:04.268248 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:04.268254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:04.268255 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:04.268480 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:04.268653 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:04.268654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:04.268654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:04.268755 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:04.268962 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:04.268967 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:04.269095 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.269243 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.269433 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":111,"threads_started":1}
I20260807 06:47:04.269752 11814 external_mini_cluster.cc:1428] Setting key fd29234a7e471560adc790c2237a65cc
I20260807 06:47:04.270298 8700 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36415
I20260807 06:47:04.270419 8700 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:04.270635 8700 heartbeater.cc:511] Master 127.11.137.190:36415 requested a full tablet report, sending...
I20260807 06:47:04.271268 8380 ts_manager.cc:194] Registered new tserver with Master: 3674ad42410746b882b8e93aabea5a6a (127.11.137.129:44835)
I20260807 06:47:04.272181 8380 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:53481
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:47:04.296545 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36415
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:04.379805 8705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:04.380009 8705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:04.380033 8705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:04.381089 8705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:04.381124 8705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:04.381150 8705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:47:04.382534 8705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:04.382725 8705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:04.382906 8705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:04.387904 8721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.387912 8717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.387917 8718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:04.388127 8705 server_base.cc:1034] running on GCE node
I20260807 06:47:04.388397 8705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:04.388693 8705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:04.389855 8705 hybrid_clock.cc:648] HybridClock initialized: now 1786085224389834 us; error 37 us; skew 500 ppm
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:04.392484 8705 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:47:04.392863 8705 webserver.cc:460] Webserver started at http://127.11.137.130:35057/ using document root <none> and password file <none>
I20260807 06:47:04.393038 8705 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:04.393077 8705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:04.393167 8705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:04.394245 8705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "5eb86c7df1d641c6813e5333e9aa2841"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "a415d1440bd3d8a80df05ed8200d9940"
server_key_iv: "ee26f247cba3a795666323ee0cd2cb8e"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.394568 8705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "5eb86c7df1d641c6813e5333e9aa2841"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "a415d1440bd3d8a80df05ed8200d9940"
server_key_iv: "ee26f247cba3a795666323ee0cd2cb8e"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.395833 8705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:04.396497 8733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.396674 8705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:04.396763 8705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "5eb86c7df1d641c6813e5333e9aa2841"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "a415d1440bd3d8a80df05ed8200d9940"
server_key_iv: "ee26f247cba3a795666323ee0cd2cb8e"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.396818 8705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:04.405745 8705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:04.407616 8705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:04.407725 8705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:04.407904 8705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:04.408207 8705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:04.408244 8705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.408267 8705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:04.408279 8705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.414160 8705 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:40399
I20260807 06:47:04.414242 8916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:40399 every 8 connection(s)
I20260807 06:47:04.414536 8705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:04.422250 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 8705
I20260807 06:47:04.422375 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:47:04.422608 11814 external_mini_cluster.cc:1428] Setting key 8e3ffb6e21f9f28227da74f20a27b36a
I20260807 06:47:04.423894 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.415317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:45405 (local address 127.11.137.190:36415)
0807 06:47:04.415401 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.415404 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.415604 (+ 200us) server_negotiation.cc:407] Connection header received
0807 06:47:04.416084 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.416085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.416097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.416150 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:04.417109 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.417676 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.418630 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.418816 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.418865 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.420924 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:04.420925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:04.420926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:04.420934 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:04.422272 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.422824 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.422825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.422826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.422899 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.423199 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.423200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.423200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.423340 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:04.423414 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.423758 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.423829 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:47:04.424228 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.415268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36415 (local address 127.11.137.130:45405)
0807 06:47:04.415473 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.415512 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.415996 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.416206 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.416209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.416824 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:04.417029 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.417033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.417758 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.417759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.418545 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.418547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.418889 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.418889 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.418989 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.419430 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:04.419438 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:04.420822 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:04.422382 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:04.422389 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:04.422392 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:04.422739 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:04.422979 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:04.422980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:04.422980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:04.423122 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:04.423424 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:04.423432 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:04.423606 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.423737 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.423920 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":129,"threads_started":1}
I20260807 06:47:04.424787 8917 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36415
I20260807 06:47:04.424896 8917 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:04.425110 8917 heartbeater.cc:511] Master 127.11.137.190:36415 requested a full tablet report, sending...
I20260807 06:47:04.425601 8380 ts_manager.cc:194] Registered new tserver with Master: 5eb86c7df1d641c6813e5333e9aa2841 (127.11.137.130:40399)
I20260807 06:47:04.426127 8380 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:45405
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:47:04.450287 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36415
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:04.536197 8928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:04.536428 8928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:04.536461 8928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:04.537861 8928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:04.537911 8928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:04.537977 8928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:47:04.539674 8928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:36415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:04.539994 8928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:04.540272 8928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:04.546087 8939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.546096 8934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.546169 8935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:04.546422 8928 server_base.cc:1034] running on GCE node
I20260807 06:47:04.546674 8928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:04.546921 8928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:04.548102 8928 hybrid_clock.cc:648] HybridClock initialized: now 1786085224548095 us; error 38 us; skew 500 ppm
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:04.550997 8928 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:47:04.551445 8928 webserver.cc:460] Webserver started at http://127.11.137.131:33353/ using document root <none> and password file <none>
I20260807 06:47:04.551687 8928 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:04.551772 8928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:04.551926 8928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:04.553020 8928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "3b02efeb13bd4a9bacd4f5613ace7489"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "4c59f6c3f818f4a9b3f106d6dbebfae6"
server_key_iv: "73a67ce3909df1d201bb5bb69d55c5cc"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.553431 8928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "3b02efeb13bd4a9bacd4f5613ace7489"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "4c59f6c3f818f4a9b3f106d6dbebfae6"
server_key_iv: "73a67ce3909df1d201bb5bb69d55c5cc"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.554805 8928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:04.555521 8955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.555713 8928 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.555814 8928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "3b02efeb13bd4a9bacd4f5613ace7489"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "4c59f6c3f818f4a9b3f106d6dbebfae6"
server_key_iv: "73a67ce3909df1d201bb5bb69d55c5cc"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.555887 8928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:04.567843 8928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:04.569836 8928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:04.570016 8928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:04.570259 8928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:04.570586 8928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:04.570643 8928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.570684 8928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:04.570712 8928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.576781 8928 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:41961
I20260807 06:47:04.576894 9112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:41961 every 8 connection(s)
I20260807 06:47:04.577248 8928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
Aug 07 06:47:04 dist-test-slave-8hhm krb5kdc[8313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:04.586187 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 8928
I20260807 06:47:04.586299 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:47:04.586498 11814 external_mini_cluster.cc:1428] Setting key 6673dce9d232de8399db2cfcf1c1d0cc
I20260807 06:47:04.586659 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.578053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:55771 (local address 127.11.137.190:36415)
0807 06:47:04.578152 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.578154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.578330 (+ 176us) server_negotiation.cc:407] Connection header received
0807 06:47:04.578815 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.578816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.578827 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.578888 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:04.579829 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.580312 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.581332 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.581511 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.581565 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.583642 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:04.583643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:04.583644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:04.583651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:04.585129 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.585551 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.585553 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.585553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.585613 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.585855 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.585856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.585856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.585975 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:04.586036 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.586433 (+ 397us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.586515 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:47:04.586907 9119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.578035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:36415 (local address 127.11.137.131:55771)
0807 06:47:04.578197 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.578240 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.578733 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.578943 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.578946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.579545 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:04.579748 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.579753 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.580402 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.580403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.581199 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.581200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.581590 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.581591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.581695 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.582165 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:04.582173 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:04.583556 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:04.585206 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:04.585250 (+ 44us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:04.585253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:04.585478 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:04.585683 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:04.585684 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:04.585684 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:04.585814 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:04.586061 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:04.586067 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:04.586238 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.586415 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.586622 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260807 06:47:04.587502 9113 heartbeater.cc:347] Connected to a master server at 127.11.137.190:36415
I20260807 06:47:04.587618 9113 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:04.587822 9113 heartbeater.cc:511] Master 127.11.137.190:36415 requested a full tablet report, sending...
I20260807 06:47:04.588251 8382 ts_manager.cc:194] Registered new tserver with Master: 3b02efeb13bd4a9bacd4f5613ace7489 (127.11.137.131:41961)
I20260807 06:47:04.588652 8382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:55771
I20260807 06:47:04.598518 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:47:04.606218 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.600099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37256 (local address 127.11.137.190:36415)
0807 06:47:04.600161 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.600163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.600310 (+ 147us) server_negotiation.cc:407] Connection header received
0807 06:47:04.600357 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.600357 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.600366 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.600426 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:04.601037 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.601593 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.602283 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.602457 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.602507 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.603901 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:04.603902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:04.603902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:04.603909 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:04.605104 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.605515 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.605515 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.605516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.605586 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:04.605799 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:04.605800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:04.605801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:04.605929 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:04.606007 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.606104 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.606154 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:47:04.607921 8382 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:47:04.609618 8382 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:47:04.616360 9133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.612126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37986 (local address 127.11.137.129:44835)
0807 06:47:04.612334 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.612340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.612350 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:47:04.612394 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.612396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.612414 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.612501 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:04.612729 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.613679 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.615221 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.615943 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.616018 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.616075 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.616239 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.616282 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":88,"threads_started":1}
I20260807 06:47:04.616365 9130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.611926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44835 (local address 127.0.0.1:37986)
0807 06:47:04.612079 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.612119 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.612192 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.612530 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.612534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.612537 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:04.612623 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.612625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.613782 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.613783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.615130 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.615133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.616030 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.616031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.616124 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.616132 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.616214 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.616275 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":27,"thread_start_us":46,"threads_started":1}
I20260807 06:47:04.616601 9131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.611938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40399 (local address 127.0.0.1:47224)
0807 06:47:04.612567 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.612578 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.612627 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.612967 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.612968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.612970 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:04.613006 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.613008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.614239 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.614241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.615186 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.615189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.616029 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.616031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.616117 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.616132 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.616214 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.616272 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":89,"threads_started":1}
I20260807 06:47:04.616863 9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.612398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47224 (local address 127.11.137.130:40399)
0807 06:47:04.612744 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.612748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.612757 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:04.612803 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.612806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.612820 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.612891 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:04.613098 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.614135 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.615275 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.615934 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.616017 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.616075 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.616321 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.616369 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":84,"threads_started":1}
I20260807 06:47:04.617128 8604 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6a87c3024a4edcbf6d0394e30f922e (DEFAULT_TABLE table=test-table [id=73855610ad7f4d6783ee15b03c68d113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:04.617409 9132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.611928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:41961 (local address 127.0.0.1:50036)
0807 06:47:04.612090 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.612121 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.612193 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.612562 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.612563 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.612565 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:04.612628 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.612630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.613993 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.613994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.615130 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.615133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.616957 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.616958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.617031 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.617264 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.617298 (+ 34us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.617341 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":4,"thread_start_us":104,"threads_started":1}
I20260807 06:47:04.617575 8604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6a87c3024a4edcbf6d0394e30f922e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:04.617579 8815 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6a87c3024a4edcbf6d0394e30f922e (DEFAULT_TABLE table=test-table [id=73855610ad7f4d6783ee15b03c68d113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:04.617796 9134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.612196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50036 (local address 127.11.137.131:41961)
0807 06:47:04.612383 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.612387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.612396 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:04.612432 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.612436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.612451 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.612707 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:04.612779 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.613887 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.616113 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.616806 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.617582 (+ 776us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.617646 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.617673 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.617717 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260807 06:47:04.617962 8815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6a87c3024a4edcbf6d0394e30f922e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:04.618422 9025 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6a87c3024a4edcbf6d0394e30f922e (DEFAULT_TABLE table=test-table [id=73855610ad7f4d6783ee15b03c68d113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:04.618739 9025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6a87c3024a4edcbf6d0394e30f922e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:04.620797 9138 tablet_bootstrap.cc:492] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Bootstrap starting.
I20260807 06:47:04.621130 9139 tablet_bootstrap.cc:492] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a: Bootstrap starting.
I20260807 06:47:04.621646 9138 tablet_bootstrap.cc:654] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:04.621840 9139 tablet_bootstrap.cc:654] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:04.622197 9142 tablet_bootstrap.cc:492] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Bootstrap starting.
I20260807 06:47:04.622351 9138 log.cc:824] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:04.622505 9139 log.cc:824] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:04.622844 9142 tablet_bootstrap.cc:654] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:04.623274 9138 tablet_bootstrap.cc:492] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: No bootstrap required, opened a new log
I20260807 06:47:04.623347 9138 ts_tablet_manager.cc:1397] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 06:47:04.623353 9139 tablet_bootstrap.cc:492] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a: No bootstrap required, opened a new log
I20260807 06:47:04.623417 9139 ts_tablet_manager.cc:1397] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:47:04.623452 9142 log.cc:824] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:04.624264 9142 tablet_bootstrap.cc:492] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: No bootstrap required, opened a new log
I20260807 06:47:04.624321 9142 ts_tablet_manager.cc:1397] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:04.624915 9138 raft_consensus.cc:348] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.625051 9138 raft_consensus.cc:374] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:04.625072 9138 raft_consensus.cc:729] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb86c7df1d641c6813e5333e9aa2841, State: Initialized, Role: FOLLOWER
I20260807 06:47:04.625198 9138 consensus_queue.cc:260] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.625528 9138 ts_tablet_manager.cc:1428] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:47:04.625546 8917 heartbeater.cc:503] Master 127.11.137.190:36415 was elected leader, sending a full tablet report...
I20260807 06:47:04.625473 9139 raft_consensus.cc:348] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.625633 9139 raft_consensus.cc:374] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:04.625669 9139 raft_consensus.cc:729] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3674ad42410746b882b8e93aabea5a6a, State: Initialized, Role: FOLLOWER
I20260807 06:47:04.625782 9139 consensus_queue.cc:260] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.626039 9139 ts_tablet_manager.cc:1428] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:47:04.626067 8700 heartbeater.cc:503] Master 127.11.137.190:36415 was elected leader, sending a full tablet report...
I20260807 06:47:04.626976 9142 raft_consensus.cc:348] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.627197 9142 raft_consensus.cc:374] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:04.627249 9142 raft_consensus.cc:729] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b02efeb13bd4a9bacd4f5613ace7489, State: Initialized, Role: FOLLOWER
I20260807 06:47:04.627360 9142 consensus_queue.cc:260] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.627681 9142 ts_tablet_manager.cc:1428] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:47:04.627754 9113 heartbeater.cc:503] Master 127.11.137.190:36415 was elected leader, sending a full tablet report...
W20260807 06:47:04.665234 8918 tablet.cc:2369] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:47:04.675467 9152 raft_consensus.cc:482] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:04.675683 9152 raft_consensus.cc:504] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.676072 9152 leader_election.cc:288] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b02efeb13bd4a9bacd4f5613ace7489 (127.11.137.131:41961), 5eb86c7df1d641c6813e5333e9aa2841 (127.11.137.130:40399)
I20260807 06:47:04.679040 9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.676444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:40653 (local address 127.11.137.130:40399)
0807 06:47:04.676492 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.676494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.676503 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:04.676537 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.676539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.676547 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.676626 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:04.676798 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.677310 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.678307 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.678685 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.678773 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.678782 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.678934 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.678973 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 06:47:04.679041 8702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.676274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40399 (local address 127.11.137.129:40653)
0807 06:47:04.676342 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.676359 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.676428 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.676633 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.676634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.676635 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:04.676717 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.676719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.677404 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.677405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.678196 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.678198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.678772 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.678773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.678855 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.678859 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.678925 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.678967 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":19}
I20260807 06:47:04.679106 9134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.676396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:36043 (local address 127.11.137.131:41961)
0807 06:47:04.676495 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.676497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.676573 (+ 76us) server_negotiation.cc:407] Connection header received
0807 06:47:04.676623 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.676624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.676634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.676725 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:04.676888 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.677416 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.678378 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.678755 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.678839 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.678847 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.678995 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.679030 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:47:04.679167 9155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.676274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:41961 (local address 127.11.137.129:36043)
0807 06:47:04.676476 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.676495 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:04.676563 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:04.676734 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:04.676735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:04.676736 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:04.676812 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.676813 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.677500 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.677501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.678282 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:04.678283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.678841 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.678842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:04.678916 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.678919 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:04.678988 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 06:47:04.679027 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":31,"thread_start_us":131,"threads_started":1}
I20260807 06:47:04.679433 8845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a87c3024a4edcbf6d0394e30f922e" candidate_uuid: "3674ad42410746b882b8e93aabea5a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb86c7df1d641c6813e5333e9aa2841" is_pre_election: true
I20260807 06:47:04.679618 8845 raft_consensus.cc:2454] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3674ad42410746b882b8e93aabea5a6a in term 0.
I20260807 06:47:04.679598 9051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a87c3024a4edcbf6d0394e30f922e" candidate_uuid: "3674ad42410746b882b8e93aabea5a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" is_pre_election: true
I20260807 06:47:04.679786 9051 raft_consensus.cc:2454] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3674ad42410746b882b8e93aabea5a6a in term 0.
I20260807 06:47:04.679890 8530 leader_election.cc:302] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3674ad42410746b882b8e93aabea5a6a, 5eb86c7df1d641c6813e5333e9aa2841; no voters:
I20260807 06:47:04.680047 9152 raft_consensus.cc:2781] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:04.680112 9152 raft_consensus.cc:482] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:04.680141 9152 raft_consensus.cc:3037] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:04.680933 9152 raft_consensus.cc:504] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.681099 9152 leader_election.cc:288] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [CANDIDATE]: Term 1 election: Requested vote from peers 3b02efeb13bd4a9bacd4f5613ace7489 (127.11.137.131:41961), 5eb86c7df1d641c6813e5333e9aa2841 (127.11.137.130:40399)
I20260807 06:47:04.681275 9051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a87c3024a4edcbf6d0394e30f922e" candidate_uuid: "3674ad42410746b882b8e93aabea5a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b02efeb13bd4a9bacd4f5613ace7489"
I20260807 06:47:04.681310 8845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a87c3024a4edcbf6d0394e30f922e" candidate_uuid: "3674ad42410746b882b8e93aabea5a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb86c7df1d641c6813e5333e9aa2841"
I20260807 06:47:04.681365 9051 raft_consensus.cc:3037] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:04.681406 8845 raft_consensus.cc:3037] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:04.682080 9051 raft_consensus.cc:2454] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3674ad42410746b882b8e93aabea5a6a in term 1.
I20260807 06:47:04.682245 8845 raft_consensus.cc:2454] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3674ad42410746b882b8e93aabea5a6a in term 1.
I20260807 06:47:04.682263 8527 leader_election.cc:302] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3674ad42410746b882b8e93aabea5a6a, 3b02efeb13bd4a9bacd4f5613ace7489; no voters:
I20260807 06:47:04.682437 9152 raft_consensus.cc:2781] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:04.682607 9152 raft_consensus.cc:686] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [term 1 LEADER]: Becoming Leader. State: Replica: 3674ad42410746b882b8e93aabea5a6a, State: Running, Role: LEADER
I20260807 06:47:04.682709 9152 consensus_queue.cc:237] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } }
I20260807 06:47:04.683553 8382 catalog_manager.cc:5495] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3674ad42410746b882b8e93aabea5a6a (127.11.137.129). New cstate: current_term: 1 leader_uuid: "3674ad42410746b882b8e93aabea5a6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3674ad42410746b882b8e93aabea5a6a" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 } health_report { overall_health: UNKNOWN } } }
I20260807 06:47:04.689405 9133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.687189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.11.137.129:44835)
0807 06:47:04.687227 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.687229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.687265 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:47:04.687328 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.687328 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.687343 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.687400 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:04.687508 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.687931 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.688633 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.688806 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.688855 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.688998 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:04.689097 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:04.689166 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.689269 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.689300 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:47:04.691190 8845 raft_consensus.cc:1261] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 1 FOLLOWER]: Refusing update from remote peer 3674ad42410746b882b8e93aabea5a6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:04.691202 9051 raft_consensus.cc:1261] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 1 FOLLOWER]: Refusing update from remote peer 3674ad42410746b882b8e93aabea5a6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:04.691581 9157 consensus_queue.cc:1035] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb86c7df1d641c6813e5333e9aa2841" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:04.691749 9152 consensus_queue.cc:1035] T 5e6a87c3024a4edcbf6d0394e30f922e P 3674ad42410746b882b8e93aabea5a6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b02efeb13bd4a9bacd4f5613ace7489" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 41961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:04.694543 9160 mvcc.cc:205] Tried to move back new op lower bound from 7315805080332320768 to 7315805080300978176. Current Snapshot: MvccSnapshot[applied={T|T < 7315805080332320768}]
I20260807 06:47:04.696878 8382 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:04.696990 8382 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:04.697794 8382 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4dc305b9e54465b837372aecd65e210: Sending DeleteTablet for 3 replicas of tablet 5e6a87c3024a4edcbf6d0394e30f922e
I20260807 06:47:04.698172 9025 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6a87c3024a4edcbf6d0394e30f922e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:04 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:50036
I20260807 06:47:04.698271 8604 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6a87c3024a4edcbf6d0394e30f922e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:04 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:37986
I20260807 06:47:04.698442 9177 tablet_replica.cc:330] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: stopping tablet replica
I20260807 06:47:04.698482 8815 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6a87c3024a4edcbf6d0394e30f922e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:04 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:47224
I20260807 06:47:04.698551 9177 raft_consensus.cc:2229] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:04.698678 9177 raft_consensus.cc:2258] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:04.698740 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 8496
I20260807 06:47:04.698805 9180 tablet_replica.cc:330] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: stopping tablet replica
I20260807 06:47:04.705688 9177 ts_tablet_manager.cc:1905] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:04.707521 9177 ts_tablet_manager.cc:1918] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:04.707599 9177 log.cc:1196] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/5e6a87c3024a4edcbf6d0394e30f922e
I20260807 06:47:04.707857 9177 ts_tablet_manager.cc:1939] T 5e6a87c3024a4edcbf6d0394e30f922e P 3b02efeb13bd4a9bacd4f5613ace7489: Deleting consensus metadata
I20260807 06:47:04.708307 8358 catalog_manager.cc:4841] TS 3b02efeb13bd4a9bacd4f5613ace7489 (127.11.137.131:41961): tablet 5e6a87c3024a4edcbf6d0394e30f922e (table test-table [id=73855610ad7f4d6783ee15b03c68d113]) successfully deleted
I20260807 06:47:04.710758 9180 raft_consensus.cc:2229] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:04.710944 9180 raft_consensus.cc:2258] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:04.711467 9180 ts_tablet_manager.cc:1905] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:04.713267 9180 ts_tablet_manager.cc:1918] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:04.713357 9180 log.cc:1196] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/5e6a87c3024a4edcbf6d0394e30f922e
I20260807 06:47:04.713658 9180 ts_tablet_manager.cc:1939] T 5e6a87c3024a4edcbf6d0394e30f922e P 5eb86c7df1d641c6813e5333e9aa2841: Deleting consensus metadata
I20260807 06:47:04.714138 8359 catalog_manager.cc:4841] TS 5eb86c7df1d641c6813e5333e9aa2841 (127.11.137.130:40399): tablet 5e6a87c3024a4edcbf6d0394e30f922e (table test-table [id=73855610ad7f4d6783ee15b03c68d113]) successfully deleted
W20260807 06:47:04.717615 8357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:44835 (error 108)
I20260807 06:47:04.717898 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 8705
I20260807 06:47:04.722786 9132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.718030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44835 (local address 127.0.0.1:38012)
0807 06:47:04.722697 (+ 4667us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:04.722751 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:44835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4636}
W20260807 06:47:04.724606 8357 catalog_manager.cc:4584] TS 3674ad42410746b882b8e93aabea5a6a (127.11.137.129:44835): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5e6a87c3024a4edcbf6d0394e30f922e: Network error: Client connection negotiation failed: client connection to 127.11.137.129:44835: connect: Connection refused (error 111)
I20260807 06:47:04.731678 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 8928
I20260807 06:47:04.745966 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 8337
2026-08-07T06:47:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2217 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T06:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:04Z Disabled control of system clock
I20260807 06:47:04.783983 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:35219
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:36245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:35219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:04.867195 9189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:04.867420 9189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:04.867440 9189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:04.868649 9189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:04.868697 9189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:04.868710 9189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:04.868723 9189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:04.868769 9189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:04.870111 9189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:35219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:04.870375 9189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:04.870703 9189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:04.875900 9202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.875864 9209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:04.875851 9201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:04.876210 9189 server_base.cc:1034] running on GCE node
I20260807 06:47:04.876422 9189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:04.876662 9189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:04.877826 9189 hybrid_clock.cc:648] HybridClock initialized: now 1786085224877798 us; error 29 us; skew 500 ppm
I20260807 06:47:04.879209 9189 webserver.cc:460] Webserver started at http://127.11.137.190:39415/ using document root <none> and password file <none>
I20260807 06:47:04.879470 9189 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:04.879524 9189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:04.879694 9189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:04.880872 9189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "ced2a51c380d421ab644e4fa876f8d8c"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "40018be472ec76d31b3d03ed56240ed6"
server_key_iv: "74da24d297e010fe145b0715bd6f1780"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.881371 9189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "ced2a51c380d421ab644e4fa876f8d8c"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "40018be472ec76d31b3d03ed56240ed6"
server_key_iv: "74da24d297e010fe145b0715bd6f1780"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.883433 9189 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 06:47:04.884533 9216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:04.884730 9189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:04.884840 9189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "ced2a51c380d421ab644e4fa876f8d8c"
format_stamp: "Formatted at 2026-08-07 06:47:04 on dist-test-slave-8hhm"
server_key: "40018be472ec76d31b3d03ed56240ed6"
server_key_iv: "74da24d297e010fe145b0715bd6f1780"
server_key_version: "encryptionkey@0"
I20260807 06:47:04.884913 9189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:04.908437 9189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:04.908800 9189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:04.908973 9189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:04.913129 9189 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:35219
I20260807 06:47:04.913172 9298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:35219 every 8 connection(s)
I20260807 06:47:04.913589 9189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:04.914642 9299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:04.916909 9299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: Bootstrap starting.
I20260807 06:47:04.917637 9299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:04.917899 9299 log.cc:824] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:04.918561 9299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: No bootstrap required, opened a new log
I20260807 06:47:04.919214 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 9189
I20260807 06:47:04.919327 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:04.919512 11814 external_mini_cluster.cc:1428] Setting key 6a2ba1ce58c65cf9311729c77c0e24fc
I20260807 06:47:04.920785 9299 raft_consensus.cc:348] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced2a51c380d421ab644e4fa876f8d8c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35219 } }
I20260807 06:47:04.920955 9299 raft_consensus.cc:374] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:04.920992 9299 raft_consensus.cc:729] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ced2a51c380d421ab644e4fa876f8d8c, State: Initialized, Role: FOLLOWER
I20260807 06:47:04.921130 9299 consensus_queue.cc:260] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced2a51c380d421ab644e4fa876f8d8c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35219 } }
I20260807 06:47:04.921298 9299 raft_consensus.cc:388] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:04.921331 9299 raft_consensus.cc:482] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:04.921380 9299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:04.922107 9299 raft_consensus.cc:504] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced2a51c380d421ab644e4fa876f8d8c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35219 } }
I20260807 06:47:04.922216 9299 leader_election.cc:302] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ced2a51c380d421ab644e4fa876f8d8c; no voters:
I20260807 06:47:04.922391 9299 leader_election.cc:288] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:04.922466 9307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:04.922612 9307 raft_consensus.cc:686] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [term 1 LEADER]: Becoming Leader. State: Replica: ced2a51c380d421ab644e4fa876f8d8c, State: Running, Role: LEADER
I20260807 06:47:04.922629 9299 sys_catalog.cc:564] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:04.922706 9307 consensus_queue.cc:237] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced2a51c380d421ab644e4fa876f8d8c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35219 } }
I20260807 06:47:04.923046 9307 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ced2a51c380d421ab644e4fa876f8d8c. Latest consensus state: current_term: 1 leader_uuid: "ced2a51c380d421ab644e4fa876f8d8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced2a51c380d421ab644e4fa876f8d8c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35219 } } }
I20260807 06:47:04.923142 9307 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:04.923055 9308 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ced2a51c380d421ab644e4fa876f8d8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced2a51c380d421ab644e4fa876f8d8c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 35219 } } }
I20260807 06:47:04.923301 9308 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c [sys.catalog]: This master's current role is: LEADER
W20260807 06:47:04.924431 9331 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:47:04.924487 9331 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:47:04.924530 9320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:04.924690 9320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:04.926417 9320 catalog_manager.cc:1347] Generated new cluster ID: 77defbb00fb94a91ae1bbfb83b2714a4
I20260807 06:47:04.926488 9320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:04.929596 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:04.920075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54058 (local address 127.11.137.190:35219)
0807 06:47:04.920308 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:04.920317 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:04.920352 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:47:04.920749 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:04.920758 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:04.920836 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:04.920986 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:04.921290 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.923134 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.924365 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:04.924939 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:04.925074 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:04.925833 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:04.925837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:04.925837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:04.926058 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:04.926101 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:04.926116 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:04.926186 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:04.929342 (+ 3156us) server_negotiation.cc:299] Negotiation successful
0807 06:47:04.929418 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":85,"threads_started":1}
I20260807 06:47:04.937178 9320 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:04.937885 9320 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:04.946117 9320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: Generated new TSK 0
I20260807 06:47:04.946326 9320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:04.953078 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35219
--builtin_ntp_servers=127.11.137.148:36245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:05.058015 9335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:05.058264 9335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:05.058288 9335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:05.059561 9335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:05.059603 9335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:05.059629 9335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:47:05.061015 9335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:05.061282 9335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:05.061601 9335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:05.066915 9340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:05.067054 9335 server_base.cc:1034] running on GCE node
W20260807 06:47:05.066911 9341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:05.066915 9345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:05.067471 9335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:05.067760 9335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:05.068933 9335 hybrid_clock.cc:648] HybridClock initialized: now 1786085225068921 us; error 28 us; skew 500 ppm
I20260807 06:47:05.070456 9335 webserver.cc:460] Webserver started at http://127.11.137.129:38369/ using document root <none> and password file <none>
I20260807 06:47:05.070736 9335 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:05.070783 9335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:05.070962 9335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:05.072153 9335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "fc16afc9eb8b4a65bfe39583a68f4d33"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "2c08f15099cbefc2d17101cb68fce266"
server_key_iv: "4029a6a88b8576082261400fde3d201e"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.072530 9335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "fc16afc9eb8b4a65bfe39583a68f4d33"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "2c08f15099cbefc2d17101cb68fce266"
server_key_iv: "4029a6a88b8576082261400fde3d201e"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.073999 9335 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:05.074815 9355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.075073 9335 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:05.075178 9335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "fc16afc9eb8b4a65bfe39583a68f4d33"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "2c08f15099cbefc2d17101cb68fce266"
server_key_iv: "4029a6a88b8576082261400fde3d201e"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.075269 9335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:05.086931 9335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:05.087265 9335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:05.087414 9335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:05.087646 9335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:05.087990 9335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:05.088056 9335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.088101 9335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:05.088130 9335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.094435 9335 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:42315
I20260807 06:47:05.094489 9525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:42315 every 8 connection(s)
I20260807 06:47:05.094811 9335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:47:05.099881 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.095546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:52097 (local address 127.11.137.190:35219)
0807 06:47:05.095633 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.095636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.095842 (+ 206us) server_negotiation.cc:407] Connection header received
0807 06:47:05.096344 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.096344 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.096357 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.096414 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:05.097059 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.097613 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.098538 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.098712 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.098760 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.099616 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:05.099617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:05.099618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:05.099622 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:05.099636 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:05.099639 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:05.099684 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.099778 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.099803 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:47:05.100091 9530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.095516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35219 (local address 127.11.137.129:52097)
0807 06:47:05.095720 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.095754 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.096246 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.096469 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.096472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.096480 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:05.096988 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.096992 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.097709 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.097709 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.098464 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.098466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.098786 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.098787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.098892 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.099475 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:05.099475 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:05.099506 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:05.099529 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:05.099707 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:05.099712 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:05.099715 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.099768 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.099848 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260807 06:47:05.100091 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 9335
I20260807 06:47:05.100214 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:47:05.100402 11814 external_mini_cluster.cc:1428] Setting key 0622db7ab3e1c5e8fb5b2be142d6c84c
I20260807 06:47:05.100831 9526 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35219
I20260807 06:47:05.100924 9526 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:05.101142 9526 heartbeater.cc:511] Master 127.11.137.190:35219 requested a full tablet report, sending...
I20260807 06:47:05.101667 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35219
--builtin_ntp_servers=127.11.137.148:36245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:47:05.101696 9240 ts_manager.cc:194] Registered new tserver with Master: fc16afc9eb8b4a65bfe39583a68f4d33 (127.11.137.129:42315)
I20260807 06:47:05.102349 9240 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.129:52097
W20260807 06:47:05.185432 9532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:05.185670 9532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:05.185710 9532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:05.187397 9532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:05.187445 9532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:05.187472 9532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:47:05.189483 9532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:05.189766 9532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:05.190153 9532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:05.196707 9540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:05.196728 9542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:05.196705 9545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:05.198393 9532 server_base.cc:1034] running on GCE node
I20260807 06:47:05.198658 9532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:05.198978 9532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:05.200205 9532 hybrid_clock.cc:648] HybridClock initialized: now 1786085225200163 us; error 39 us; skew 500 ppm
I20260807 06:47:05.201936 9532 webserver.cc:460] Webserver started at http://127.11.137.130:46623/ using document root <none> and password file <none>
I20260807 06:47:05.202298 9532 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:05.202368 9532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:05.202521 9532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:05.204234 9532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "3f3b9bbaae4c42f78ab999cf38589232"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "85dc3468d4386e2e55743c81bb0f0d92"
server_key_iv: "33ea4f0c0e9507d58efa3dcc772f3a8c"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.204793 9532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "3f3b9bbaae4c42f78ab999cf38589232"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "85dc3468d4386e2e55743c81bb0f0d92"
server_key_iv: "33ea4f0c0e9507d58efa3dcc772f3a8c"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.206853 9532 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.004s
I20260807 06:47:05.208750 9553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.208943 9532 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:47:05.209028 9532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "3f3b9bbaae4c42f78ab999cf38589232"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "85dc3468d4386e2e55743c81bb0f0d92"
server_key_iv: "33ea4f0c0e9507d58efa3dcc772f3a8c"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.209108 9532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:05.233506 9532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:05.233870 9532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:05.234071 9532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:05.234364 9532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:05.234784 9532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:05.234840 9532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.234880 9532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:05.234905 9532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.241761 9532 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:40677
I20260807 06:47:05.241827 9725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:40677 every 8 connection(s)
I20260807 06:47:05.242188 9532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:47:05.247630 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.242998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:47883 (local address 127.11.137.190:35219)
0807 06:47:05.243046 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.243048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.243329 (+ 281us) server_negotiation.cc:407] Connection header received
0807 06:47:05.243911 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.243912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.243925 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.243971 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:05.244697 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.245205 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.246232 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.246439 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.246532 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.247337 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:05.247339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:05.247339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:05.247345 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:05.247360 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:05.247364 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:05.247409 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.247517 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.247548 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:47:05.247882 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.242996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35219 (local address 127.11.137.130:47883)
0807 06:47:05.243198 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.243234 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.243784 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.244067 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.244070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.244079 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:05.244597 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.244601 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.245341 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.245346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.246134 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.246136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.246546 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.246547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.246678 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.247195 (+ 517us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:05.247195 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:05.247224 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:05.247246 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:05.247420 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:05.247424 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:05.247427 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.247511 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.247616 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260807 06:47:05.248485 9727 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35219
I20260807 06:47:05.248576 9727 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:05.248770 9727 heartbeater.cc:511] Master 127.11.137.190:35219 requested a full tablet report, sending...
I20260807 06:47:05.249194 9240 ts_manager.cc:194] Registered new tserver with Master: 3f3b9bbaae4c42f78ab999cf38589232 (127.11.137.130:40677)
I20260807 06:47:05.249650 9240 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.130:47883
I20260807 06:47:05.250358 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 9532
I20260807 06:47:05.250442 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:47:05.250664 11814 external_mini_cluster.cc:1428] Setting key aff61e42fe1244047f5e16ab912527b8
I20260807 06:47:05.251546 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35219
--builtin_ntp_servers=127.11.137.148:36245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:05.336524 9733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:05.336791 9733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:05.336827 9733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:05.338004 9733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:05.338073 9733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:05.338112 9733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:47:05.339507 9733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:36245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:05.339773 9733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:05.340070 9733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:05.345309 9738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:05.345350 9739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:05.345314 9743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:05.345538 9733 server_base.cc:1034] running on GCE node
I20260807 06:47:05.345835 9733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:05.346076 9733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:05.347225 9733 hybrid_clock.cc:648] HybridClock initialized: now 1786085225347214 us; error 26 us; skew 500 ppm
I20260807 06:47:05.348476 9733 webserver.cc:460] Webserver started at http://127.11.137.131:37875/ using document root <none> and password file <none>
I20260807 06:47:05.348721 9733 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:05.348769 9733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:05.348942 9733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:05.350098 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "7c816569cfe3414f9ddb6a11542ff0a7"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "1c083b67db1e2f52c622f01721e66e7b"
server_key_iv: "7c7100ed3d0cefc643b41ddd4de44fbd"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.350483 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "7c816569cfe3414f9ddb6a11542ff0a7"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "1c083b67db1e2f52c622f01721e66e7b"
server_key_iv: "7c7100ed3d0cefc643b41ddd4de44fbd"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.351824 9733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:47:05.352538 9751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.352712 9733 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:05.352785 9733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "7c816569cfe3414f9ddb6a11542ff0a7"
format_stamp: "Formatted at 2026-08-07 06:47:05 on dist-test-slave-8hhm"
server_key: "1c083b67db1e2f52c622f01721e66e7b"
server_key_iv: "7c7100ed3d0cefc643b41ddd4de44fbd"
server_key_version: "encryptionkey@0"
I20260807 06:47:05.352880 9733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:05.401784 9733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:05.402137 9733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:05.402302 9733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:05.402627 9733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:05.403013 9733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:05.403070 9733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.403106 9733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:05.403136 9733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:05.409143 9733 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:33015
I20260807 06:47:05.409193 9912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:33015 every 8 connection(s)
I20260807 06:47:05.409554 9733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:47:05.414999 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.410281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:35585 (local address 127.11.137.190:35219)
0807 06:47:05.410327 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.410329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.410585 (+ 256us) server_negotiation.cc:407] Connection header received
0807 06:47:05.411133 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.411134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.411147 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.411212 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:05.411947 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.412460 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.413524 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.413734 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.413834 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.414689 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:05.414691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:05.414691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:05.414696 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:05.414711 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:05.414716 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:05.414772 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.414884 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.414916 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:47:05.415213 9919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.410279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:35219 (local address 127.11.137.131:35585)
0807 06:47:05.410431 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.410465 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.411018 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.411290 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.411293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.411302 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:05.411844 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.411848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.412578 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.412579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.413431 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.413433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.413845 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.413846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.413985 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.414534 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:05.414534 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:05.414572 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:05.414596 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:05.414775 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:05.414780 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:05.414784 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.414873 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.414977 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":65,"threads_started":1}
I20260807 06:47:05.415743 9914 heartbeater.cc:347] Connected to a master server at 127.11.137.190:35219
I20260807 06:47:05.415846 9914 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:05.416036 9914 heartbeater.cc:511] Master 127.11.137.190:35219 requested a full tablet report, sending...
I20260807 06:47:05.416453 9240 ts_manager.cc:194] Registered new tserver with Master: 7c816569cfe3414f9ddb6a11542ff0a7 (127.11.137.131:33015)
I20260807 06:47:05.416836 9240 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.131:35585
I20260807 06:47:05.417753 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 9733
I20260807 06:47:05.417858 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:47:05.418092 11814 external_mini_cluster.cc:1428] Setting key 3622114df1340578ec08da3d0bcc4451
I20260807 06:47:05.418891 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:47:05.423117 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.420299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54072 (local address 127.11.137.190:35219)
0807 06:47:05.420357 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.420364 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.420478 (+ 114us) server_negotiation.cc:407] Connection header received
0807 06:47:05.420506 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.420506 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.420517 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.420565 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:05.420702 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.421145 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.421887 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.422078 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.422167 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.422848 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:05.422849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:05.422849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:05.422853 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:05.422866 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:05.422869 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:05.422939 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.423004 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.423055 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 06:47:05.424922 9240 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:47:05.426586 9240 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:47:05.433046 9934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.429045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49358 (local address 127.11.137.131:33015)
0807 06:47:05.429276 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.429281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.429694 (+ 413us) server_negotiation.cc:407] Connection header received
0807 06:47:05.429739 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.429741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.429757 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.429831 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:05.429966 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.430783 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.432108 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.432642 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.432737 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.432829 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.432917 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.432954 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260807 06:47:05.433032 9932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.428773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:33015 (local address 127.0.0.1:49358)
0807 06:47:05.429316 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.429327 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.429398 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.429841 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.429841 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.429843 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:05.429884 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.429889 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.430857 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.430858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.432006 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.432009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.432739 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.432740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.432816 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.432829 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.432906 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.432958 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":7,"thread_start_us":66,"threads_started":1}
I20260807 06:47:05.433725 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.428758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42315 (local address 127.0.0.1:40980)
0807 06:47:05.429262 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.429306 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.429398 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.429905 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.429906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.429908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:05.429974 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.429976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.431059 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.431060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.432150 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.432153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.433479 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.433480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.433540 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.433544 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.433616 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.433655 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":78,"threads_started":1}
I20260807 06:47:05.433779 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.428854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.11.137.129:42315)
0807 06:47:05.429017 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.429023 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.429409 (+ 386us) server_negotiation.cc:407] Connection header received
0807 06:47:05.429499 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.429502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.429521 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.429602 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:05.430045 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.430961 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.432237 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.432956 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.433026 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.433102 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.433650 (+ 548us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.433695 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260807 06:47:05.433917 9818 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba40c2a4fa34ff09e920a416bb10bbc (DEFAULT_TABLE table=test-table [id=7ccce5d818f14ca4beaf41ff0d9ad793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:05.434309 9818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ba40c2a4fa34ff09e920a416bb10bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:05.434589 9927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.428995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40677 (local address 127.0.0.1:35770)
0807 06:47:05.429499 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.429507 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.429553 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.429786 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.429789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.429791 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:05.429884 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.429886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.432072 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.432073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.433157 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.433161 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.434357 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.434358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.434431 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.434435 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.434490 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.434527 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":56,"threads_started":1}
I20260807 06:47:05.434842 9935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.429126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35770 (local address 127.11.137.130:40677)
0807 06:47:05.429380 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.429384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.429555 (+ 171us) server_negotiation.cc:407] Connection header received
0807 06:47:05.429631 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.429633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.429647 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.429769 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:05.430867 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.431979 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.433334 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.434002 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.434101 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.434190 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.434702 (+ 512us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.434751 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":108,"threads_started":1}
I20260807 06:47:05.434764 9432 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba40c2a4fa34ff09e920a416bb10bbc (DEFAULT_TABLE table=test-table [id=7ccce5d818f14ca4beaf41ff0d9ad793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:05.435102 9432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ba40c2a4fa34ff09e920a416bb10bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:05.437196 9937 tablet_bootstrap.cc:492] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Bootstrap starting.
I20260807 06:47:05.437680 9938 tablet_bootstrap.cc:492] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: Bootstrap starting.
I20260807 06:47:05.438148 9937 tablet_bootstrap.cc:654] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:05.438365 9938 tablet_bootstrap.cc:654] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:05.438508 9937 log.cc:824] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:05.438515 9627 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba40c2a4fa34ff09e920a416bb10bbc (DEFAULT_TABLE table=test-table [id=7ccce5d818f14ca4beaf41ff0d9ad793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:05.438704 9938 log.cc:824] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:05.438911 9627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ba40c2a4fa34ff09e920a416bb10bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:05.439395 9937 tablet_bootstrap.cc:492] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: No bootstrap required, opened a new log
I20260807 06:47:05.439473 9937 ts_tablet_manager.cc:1397] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:47:05.439505 9938 tablet_bootstrap.cc:492] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: No bootstrap required, opened a new log
I20260807 06:47:05.439592 9938 ts_tablet_manager.cc:1397] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:47:05.441699 9938 raft_consensus.cc:348] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.441866 9938 raft_consensus.cc:374] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:05.441911 9938 raft_consensus.cc:729] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc16afc9eb8b4a65bfe39583a68f4d33, State: Initialized, Role: FOLLOWER
I20260807 06:47:05.442070 9938 consensus_queue.cc:260] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.442204 9937 raft_consensus.cc:348] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.442364 9938 ts_tablet_manager.cc:1428] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:47:05.442370 9937 raft_consensus.cc:374] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:05.442425 9937 raft_consensus.cc:729] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c816569cfe3414f9ddb6a11542ff0a7, State: Initialized, Role: FOLLOWER
I20260807 06:47:05.442543 9937 consensus_queue.cc:260] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.442668 9944 tablet_bootstrap.cc:492] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Bootstrap starting.
I20260807 06:47:05.442809 9937 ts_tablet_manager.cc:1428] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260807 06:47:05.442873 9914 heartbeater.cc:503] Master 127.11.137.190:35219 was elected leader, sending a full tablet report...
I20260807 06:47:05.443328 9944 tablet_bootstrap.cc:654] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:05.443672 9944 log.cc:824] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:05.443886 9526 heartbeater.cc:503] Master 127.11.137.190:35219 was elected leader, sending a full tablet report...
I20260807 06:47:05.444697 9944 tablet_bootstrap.cc:492] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: No bootstrap required, opened a new log
I20260807 06:47:05.444773 9944 ts_tablet_manager.cc:1397] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:47:05.446715 9944 raft_consensus.cc:348] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.446846 9944 raft_consensus.cc:374] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:05.446869 9944 raft_consensus.cc:729] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3b9bbaae4c42f78ab999cf38589232, State: Initialized, Role: FOLLOWER
I20260807 06:47:05.447021 9944 consensus_queue.cc:260] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.447295 9944 ts_tablet_manager.cc:1428] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:47:05.447352 9727 heartbeater.cc:503] Master 127.11.137.190:35219 was elected leader, sending a full tablet report...
W20260807 06:47:05.492784 9729 tablet.cc:2369] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:47:05.519634 9943 raft_consensus.cc:482] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:05.519822 9943 raft_consensus.cc:504] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.520309 9943 leader_election.cc:288] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c816569cfe3414f9ddb6a11542ff0a7 (127.11.137.131:33015), 3f3b9bbaae4c42f78ab999cf38589232 (127.11.137.130:40677)
I20260807 06:47:05.524425 9934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.520666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:33219 (local address 127.11.137.131:33015)
0807 06:47:05.520756 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.520759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.520770 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:47:05.520807 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.520808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.520818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.520885 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:05.521085 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.521919 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.523490 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.524053 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.524150 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.524161 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.524313 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.524358 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:47:05.524425 9530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.520538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:33015 (local address 127.11.137.129:33219)
0807 06:47:05.520609 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.520623 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.520701 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.520916 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.520917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.520919 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:05.520995 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.520997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.522012 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.522013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.523372 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.523375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.524158 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.524159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.524228 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.524231 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.524303 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.524347 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":81}
I20260807 06:47:05.524547 9935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.520750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:49773 (local address 127.11.137.130:40677)
0807 06:47:05.520801 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.520803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.520953 (+ 150us) server_negotiation.cc:407] Connection header received
0807 06:47:05.521010 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.521010 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.521020 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.521119 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:05.521249 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.521930 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.523489 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.524043 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.524179 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.524187 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.524408 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.524453 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:47:05.524755 9949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.520670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40677 (local address 127.11.137.129:49773)
0807 06:47:05.520886 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.520896 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:05.520957 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:05.521119 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:05.521119 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:05.521121 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:05.521178 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.521179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.522012 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.522013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.523372 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:05.523375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.524217 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.524218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:05.524337 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.524341 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:05.524390 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:47:05.524431 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":40,"thread_start_us":133,"threads_started":1}
I20260807 06:47:05.525077 9846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba40c2a4fa34ff09e920a416bb10bbc" candidate_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" is_pre_election: true
I20260807 06:47:05.525300 9846 raft_consensus.cc:2454] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc16afc9eb8b4a65bfe39583a68f4d33 in term 0.
I20260807 06:47:05.525264 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba40c2a4fa34ff09e920a416bb10bbc" candidate_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3b9bbaae4c42f78ab999cf38589232" is_pre_election: true
I20260807 06:47:05.525429 9659 raft_consensus.cc:2454] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc16afc9eb8b4a65bfe39583a68f4d33 in term 0.
I20260807 06:47:05.525548 9360 leader_election.cc:302] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c816569cfe3414f9ddb6a11542ff0a7, fc16afc9eb8b4a65bfe39583a68f4d33; no voters:
I20260807 06:47:05.525745 9943 raft_consensus.cc:2781] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:05.525822 9943 raft_consensus.cc:482] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:05.525852 9943 raft_consensus.cc:3037] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:05.526571 9943 raft_consensus.cc:504] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.526724 9943 leader_election.cc:288] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [CANDIDATE]: Term 1 election: Requested vote from peers 7c816569cfe3414f9ddb6a11542ff0a7 (127.11.137.131:33015), 3f3b9bbaae4c42f78ab999cf38589232 (127.11.137.130:40677)
I20260807 06:47:05.526919 9846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba40c2a4fa34ff09e920a416bb10bbc" candidate_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c816569cfe3414f9ddb6a11542ff0a7"
I20260807 06:47:05.526942 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba40c2a4fa34ff09e920a416bb10bbc" candidate_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3b9bbaae4c42f78ab999cf38589232"
I20260807 06:47:05.527007 9846 raft_consensus.cc:3037] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:05.527029 9659 raft_consensus.cc:3037] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:05.527745 9659 raft_consensus.cc:2454] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc16afc9eb8b4a65bfe39583a68f4d33 in term 1.
I20260807 06:47:05.527794 9846 raft_consensus.cc:2454] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc16afc9eb8b4a65bfe39583a68f4d33 in term 1.
I20260807 06:47:05.527966 9360 leader_election.cc:302] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c816569cfe3414f9ddb6a11542ff0a7, fc16afc9eb8b4a65bfe39583a68f4d33; no voters:
I20260807 06:47:05.528074 9943 raft_consensus.cc:2781] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:05.528241 9943 raft_consensus.cc:686] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 1 LEADER]: Becoming Leader. State: Replica: fc16afc9eb8b4a65bfe39583a68f4d33, State: Running, Role: LEADER
I20260807 06:47:05.528350 9943 consensus_queue.cc:237] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } }
I20260807 06:47:05.529261 9240 catalog_manager.cc:5495] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc16afc9eb8b4a65bfe39583a68f4d33 (127.11.137.129). New cstate: current_term: 1 leader_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc16afc9eb8b4a65bfe39583a68f4d33" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 } health_report { overall_health: UNKNOWN } } }
I20260807 06:47:05.552776 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.550530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40994 (local address 127.11.137.129:42315)
0807 06:47:05.550597 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:05.550599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:05.550607 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:47:05.550652 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:05.550652 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:05.550673 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:05.550738 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:05.550884 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.551345 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.552052 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:05.552237 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:05.552285 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:05.552428 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:05.552512 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:05.552582 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:05.552627 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 06:47:05.552637 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:47:05.554775 9846 raft_consensus.cc:1261] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 1 FOLLOWER]: Refusing update from remote peer fc16afc9eb8b4a65bfe39583a68f4d33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:05.554788 9659 raft_consensus.cc:1261] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 1 FOLLOWER]: Refusing update from remote peer fc16afc9eb8b4a65bfe39583a68f4d33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:05.555135 9950 consensus_queue.cc:1035] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c816569cfe3414f9ddb6a11542ff0a7" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:05.555258 9943 consensus_queue.cc:1035] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3b9bbaae4c42f78ab999cf38589232" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:05.558092 9958 mvcc.cc:205] Tried to move back new op lower bound from 7315805083869499392 to 7315805083764686848. Current Snapshot: MvccSnapshot[applied={T|T < 7315805083869499392}]
I20260807 06:47:05.561233 9239 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:05.561332 9239 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:05.562144 9239 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ced2a51c380d421ab644e4fa876f8d8c: Sending DeleteTablet for 3 replicas of tablet 2ba40c2a4fa34ff09e920a416bb10bbc
I20260807 06:47:05.562461 9432 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ba40c2a4fa34ff09e920a416bb10bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:05 UTC) from {username='slave'} at 127.0.0.1:40980
I20260807 06:47:05.562531 9627 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ba40c2a4fa34ff09e920a416bb10bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:05 UTC) from {username='slave'} at 127.0.0.1:35770
I20260807 06:47:05.562753 9967 tablet_replica.cc:330] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33: stopping tablet replica
I20260807 06:47:05.562722 9818 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ba40c2a4fa34ff09e920a416bb10bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:05 UTC) from {username='slave'} at 127.0.0.1:49358
I20260807 06:47:05.562805 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 9335
I20260807 06:47:05.562940 9967 raft_consensus.cc:2229] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:47:05.563079 9967 raft_consensus.cc:2258] T 2ba40c2a4fa34ff09e920a416bb10bbc P fc16afc9eb8b4a65bfe39583a68f4d33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:05.573120 9968 tablet_replica.cc:330] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: stopping tablet replica
I20260807 06:47:05.573308 9968 raft_consensus.cc:2229] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:05.573443 9968 raft_consensus.cc:2258] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:05.573649 9970 tablet_replica.cc:330] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: stopping tablet replica
I20260807 06:47:05.573771 9970 raft_consensus.cc:2229] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:05.573889 9970 raft_consensus.cc:2258] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:05.574200 9968 ts_tablet_manager.cc:1905] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:05.574375 9970 ts_tablet_manager.cc:1905] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:05.575969 9968 ts_tablet_manager.cc:1918] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:05.576063 9968 log.cc:1196] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/2ba40c2a4fa34ff09e920a416bb10bbc
I20260807 06:47:05.576367 9968 ts_tablet_manager.cc:1939] T 2ba40c2a4fa34ff09e920a416bb10bbc P 3f3b9bbaae4c42f78ab999cf38589232: Deleting consensus metadata
I20260807 06:47:05.576500 9970 ts_tablet_manager.cc:1918] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:05.576591 9970 log.cc:1196] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/2ba40c2a4fa34ff09e920a416bb10bbc
I20260807 06:47:05.576833 9970 ts_tablet_manager.cc:1939] T 2ba40c2a4fa34ff09e920a416bb10bbc P 7c816569cfe3414f9ddb6a11542ff0a7: Deleting consensus metadata
I20260807 06:47:05.576889 9219 catalog_manager.cc:4841] TS 3f3b9bbaae4c42f78ab999cf38589232 (127.11.137.130:40677): tablet 2ba40c2a4fa34ff09e920a416bb10bbc (table test-table [id=7ccce5d818f14ca4beaf41ff0d9ad793]) successfully deleted
I20260807 06:47:05.577279 9219 catalog_manager.cc:4841] TS 7c816569cfe3414f9ddb6a11542ff0a7 (127.11.137.131:33015): tablet 2ba40c2a4fa34ff09e920a416bb10bbc (table test-table [id=7ccce5d818f14ca4beaf41ff0d9ad793]) successfully deleted
W20260807 06:47:05.578598 9220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:42315 (error 108)
I20260807 06:47:05.579108 9927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:05.578965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:42315 (local address 127.0.0.1:41010)
0807 06:47:05.579019 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:05.579069 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:42315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 06:47:05.579125 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 9532
W20260807 06:47:05.581351 9220 catalog_manager.cc:4584] TS fc16afc9eb8b4a65bfe39583a68f4d33 (127.11.137.129:42315): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ba40c2a4fa34ff09e920a416bb10bbc: Network error: Client connection negotiation failed: client connection to 127.11.137.129:42315: connect: Connection refused (error 111)
I20260807 06:47:05.590291 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 9733
I20260807 06:47:05.602669 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 9189
2026-08-07T06:47:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (853 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:05 dist-test-slave-8hhm krb5kdc[9976](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:05 dist-test-slave-8hhm krb5kdc[9976](info): set up 2 sockets
Aug 07 06:47:05 dist-test-slave-8hhm krb5kdc[9976](info): commencing operation
krb5kdc: starting...
W20260807 06:47:06.852357 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:06 dist-test-slave-8hhm krb5kdc[9976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:06.978399 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42189
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:42189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:07.060424 9998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:07.060688 9998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:07.060729 9998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:07.061887 9998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:07.061962 9998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:07.061985 9998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:07.062006 9998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:07.062036 9998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:07.063508 9998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:42189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:07.063807 9998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:07.064039 9998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:07.069001 10004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:07.069007 10005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.069124 9998 server_base.cc:1034] running on GCE node
W20260807 06:47:07.069185 10009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.069588 9998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:07.069895 9998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:07.071069 9998 hybrid_clock.cc:648] HybridClock initialized: now 1786085227071049 us; error 28 us; skew 500 ppm
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:07.079303 9998 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:07.079778 9998 webserver.cc:460] Webserver started at http://127.11.137.190:38137/ using document root <none> and password file <none>
I20260807 06:47:07.080031 9998 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:07.080101 9998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:07.080258 9998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:07.081419 9998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "ceb890951d3d4e6cb611ecb4522d2690"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "11f6ec2f67c68a899f295918df9cbef4"
server_key_iv: "b45f71e5ed57eaf27310abb092a5a197"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.081806 9998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "ceb890951d3d4e6cb611ecb4522d2690"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "11f6ec2f67c68a899f295918df9cbef4"
server_key_iv: "b45f71e5ed57eaf27310abb092a5a197"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.083153 9998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:07.083953 10016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.084153 9998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:07.084259 9998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "ceb890951d3d4e6cb611ecb4522d2690"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "11f6ec2f67c68a899f295918df9cbef4"
server_key_iv: "b45f71e5ed57eaf27310abb092a5a197"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.084316 9998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:07.107298 9998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:07.109311 9998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:07.109429 9998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:07.113585 9998 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:42189
I20260807 06:47:07.113627 10091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:42189 every 8 connection(s)
I20260807 06:47:07.114017 9998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:07.114907 10092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:07.117264 10092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690: Bootstrap starting.
I20260807 06:47:07.117873 10092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:07.118180 10092 log.cc:824] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:07.118875 10092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690: No bootstrap required, opened a new log
I20260807 06:47:07.120484 10092 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb890951d3d4e6cb611ecb4522d2690" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42189 } }
I20260807 06:47:07.120628 10092 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:07.120685 10092 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb890951d3d4e6cb611ecb4522d2690, State: Initialized, Role: FOLLOWER
I20260807 06:47:07.120846 10092 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb890951d3d4e6cb611ecb4522d2690" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42189 } }
I20260807 06:47:07.120929 10092 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:07.120978 10092 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:07.121029 10092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:07.121582 10092 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb890951d3d4e6cb611ecb4522d2690" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42189 } }
I20260807 06:47:07.121695 10092 leader_election.cc:302] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceb890951d3d4e6cb611ecb4522d2690; no voters:
I20260807 06:47:07.121861 10092 leader_election.cc:288] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:07.121896 10095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:07.122064 10095 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [term 1 LEADER]: Becoming Leader. State: Replica: ceb890951d3d4e6cb611ecb4522d2690, State: Running, Role: LEADER
I20260807 06:47:07.122118 10092 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:07.122154 10095 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb890951d3d4e6cb611ecb4522d2690" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42189 } }
I20260807 06:47:07.122552 10097 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceb890951d3d4e6cb611ecb4522d2690" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb890951d3d4e6cb611ecb4522d2690" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42189 } } }
I20260807 06:47:07.122639 10097 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:07.122802 10099 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceb890951d3d4e6cb611ecb4522d2690. Latest consensus state: current_term: 1 leader_uuid: "ceb890951d3d4e6cb611ecb4522d2690" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb890951d3d4e6cb611ecb4522d2690" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42189 } } }
I20260807 06:47:07.122947 10099 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:07.123111 10106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:07.123649 10106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:07.124058 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 9998
I20260807 06:47:07.124197 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:07.124387 11814 external_mini_cluster.cc:1428] Setting key 3bdcc6054deca0a3b5037332f5b694de
I20260807 06:47:07.125589 10106 catalog_manager.cc:1347] Generated new cluster ID: 8aa822faa9dc40ea9bc1921fa2db4c39
I20260807 06:47:07.125641 10106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:07.136269 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.124908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37828 (local address 127.11.137.190:42189)
0807 06:47:07.125486 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.125495 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.125524 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:47:07.125637 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.125644 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.125712 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.125851 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:07.126608 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.127970 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.128962 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.129641 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.129765 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.132600 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:07.132604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:07.132604 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:07.132616 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:07.134605 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.135023 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.135026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.135026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.135138 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.135353 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.135354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.135354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.135633 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:07.135788 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.135906 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.136030 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":86,"threads_started":1}
I20260807 06:47:07.151829 10106 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:07.152557 10106 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:07.157027 10106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690: Generated new TSK 0
I20260807 06:47:07.157263 10106 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.137.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
Entry for principal kudu/127.11.137.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab.
I20260807 06:47:07.191677 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42189
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:07.281068 10127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:07.281342 10127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:07.281390 10127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:07.282509 10127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:07.282546 10127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:07.282579 10127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:47:07.284034 10127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.129.keytab
--principal=kudu/127.11.137.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:07.284225 10127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:07.284499 10127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:07.289912 10134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:07.289942 10137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:07.289942 10135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.290117 10127 server_base.cc:1034] running on GCE node
I20260807 06:47:07.290319 10127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:07.290542 10127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:07.291713 10127 hybrid_clock.cc:648] HybridClock initialized: now 1786085227291676 us; error 38 us; skew 500 ppm
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:07.294627 10127 init.cc:377] Logged in from keytab as kudu/127.11.137.129@KRBTEST.COM (short username kudu)
I20260807 06:47:07.295137 10127 webserver.cc:460] Webserver started at http://127.11.137.129:43873/ using document root <none> and password file <none>
I20260807 06:47:07.295368 10127 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:07.295416 10127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:07.295583 10127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:07.296689 10127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "fb0c2974e67f41f39f644bc9ad826324"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "bcbd46389175ec6b951979a599c14ad7"
server_key_iv: "37d808bbceb0c7b698b8233dddd7da5a"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.297072 10127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "fb0c2974e67f41f39f644bc9ad826324"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "bcbd46389175ec6b951979a599c14ad7"
server_key_iv: "37d808bbceb0c7b698b8233dddd7da5a"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.298457 10127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:07.299218 10151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.299396 10127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.299506 10127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "fb0c2974e67f41f39f644bc9ad826324"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "bcbd46389175ec6b951979a599c14ad7"
server_key_iv: "37d808bbceb0c7b698b8233dddd7da5a"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.299600 10127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:07.315366 10127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:07.317392 10127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:07.317574 10127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:07.317821 10127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:07.318152 10127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:07.318207 10127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.318243 10127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:07.318270 10127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.324273 10127 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:37379
I20260807 06:47:07.324357 10323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:37379 every 8 connection(s)
I20260807 06:47:07.324697 10127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:47:07.327629 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 10127
I20260807 06:47:07.327718 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:47:07.327932 11814 external_mini_cluster.cc:1428] Setting key 96976c12bb5fc641bf33538fb3eb60fd
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.129@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:07.335176 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.325478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:52361 (local address 127.11.137.190:42189)
0807 06:47:07.325549 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.325551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.325780 (+ 229us) server_negotiation.cc:407] Connection header received
0807 06:47:07.326288 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.326289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.326302 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.326355 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:07.327349 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.327933 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.329199 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.329426 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.329480 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.332089 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:07.332090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:07.332090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:07.332100 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:07.333506 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.334064 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.334065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.334066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.334135 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.334453 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.334454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.334454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.334572 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:07.334634 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.335022 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.335107 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 06:47:07.335464 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.325475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42189 (local address 127.11.137.129:52361)
0807 06:47:07.325674 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.325713 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.326199 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.326408 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.326411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.326997 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:07.327203 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.327208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.328063 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.328064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.329111 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.329115 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.329518 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.329519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.329700 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.330301 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:07.330311 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:07.331999 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:07.333586 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:07.333594 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:07.333596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:07.333936 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:07.334219 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:07.334220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:07.334221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:07.334373 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:07.334648 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:07.334656 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:07.334846 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.334978 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.335172 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":116,"threads_started":1}
I20260807 06:47:07.336097 10324 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42189
I20260807 06:47:07.336208 10324 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:07.336407 10324 heartbeater.cc:511] Master 127.11.137.190:42189 requested a full tablet report, sending...
I20260807 06:47:07.336990 10042 ts_manager.cc:194] Registered new tserver with Master: fb0c2974e67f41f39f644bc9ad826324 (127.11.137.129:37379)
I20260807 06:47:07.337646 10042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.129@KRBTEST.COM'} at 127.11.137.129:52361
WARNING: no policy specified for kudu/127.11.137.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
Entry for principal kudu/127.11.137.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab.
I20260807 06:47:07.356520 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42189
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:07.440261 10330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:07.440513 10330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:07.440554 10330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:07.441826 10330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:07.441888 10330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:07.441933 10330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:47:07.443418 10330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.130.keytab
--principal=kudu/127.11.137.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:07.443708 10330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:07.443955 10330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:07.449417 10336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:07.449429 10337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.449628 10330 server_base.cc:1034] running on GCE node
W20260807 06:47:07.449417 10339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.449908 10330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:07.450166 10330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:07.451318 10330 hybrid_clock.cc:648] HybridClock initialized: now 1786085227451311 us; error 33 us; skew 500 ppm
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:07.453913 10330 init.cc:377] Logged in from keytab as kudu/127.11.137.130@KRBTEST.COM (short username kudu)
I20260807 06:47:07.454303 10330 webserver.cc:460] Webserver started at http://127.11.137.130:38083/ using document root <none> and password file <none>
I20260807 06:47:07.454548 10330 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:07.454619 10330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:07.454779 10330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:07.455845 10330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "30f6cca66052488fbc2e501a44f77bfb"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "a9ee7e7d3daf897312cd6e2fac05cdec"
server_key_iv: "94df8fb505ce12f33275eac6c2f1fa28"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.456233 10330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "30f6cca66052488fbc2e501a44f77bfb"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "a9ee7e7d3daf897312cd6e2fac05cdec"
server_key_iv: "94df8fb505ce12f33275eac6c2f1fa28"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.457679 10330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:07.458492 10347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.458686 10330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:07.458796 10330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "30f6cca66052488fbc2e501a44f77bfb"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "a9ee7e7d3daf897312cd6e2fac05cdec"
server_key_iv: "94df8fb505ce12f33275eac6c2f1fa28"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.458871 10330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:07.484349 10330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:07.486582 10330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:07.486765 10330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:07.487040 10330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:07.487425 10330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:07.487491 10330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.487528 10330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:07.487555 10330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.493661 10330 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:40135
I20260807 06:47:07.493708 10508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:40135 every 8 connection(s)
I20260807 06:47:07.494048 10330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.130@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:07.502755 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 10330
I20260807 06:47:07.502882 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:47:07.503093 11814 external_mini_cluster.cc:1428] Setting key 83c454571785a35938e74405862fe7c6
I20260807 06:47:07.503149 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.494794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:57337 (local address 127.11.137.190:42189)
0807 06:47:07.494882 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.494884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.495048 (+ 164us) server_negotiation.cc:407] Connection header received
0807 06:47:07.495526 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.495527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.495537 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.495592 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:07.496565 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.497059 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.498049 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.498227 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.498282 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.500400 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:07.500401 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:07.500402 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:07.500408 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:07.501651 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.502118 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.502119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.502119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.502172 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.502455 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.502455 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.502456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.502587 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:07.502641 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.502996 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.503065 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:47:07.503438 10512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.494739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42189 (local address 127.11.137.130:57337)
0807 06:47:07.494921 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.494960 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.495441 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.495652 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.495655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.496262 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:07.496467 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.496471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.497143 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.497144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.497944 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.497946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.498305 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.498306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.498408 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.498898 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:07.498905 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:07.500310 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:07.501818 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:07.501824 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:07.501826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:07.502045 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:07.502233 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:07.502234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:07.502234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:07.502407 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:07.502658 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:07.502665 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:07.502840 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.502967 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.503142 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260807 06:47:07.504078 10509 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42189
I20260807 06:47:07.504195 10509 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:07.504388 10509 heartbeater.cc:511] Master 127.11.137.190:42189 requested a full tablet report, sending...
I20260807 06:47:07.504747 10042 ts_manager.cc:194] Registered new tserver with Master: 30f6cca66052488fbc2e501a44f77bfb (127.11.137.130:40135)
I20260807 06:47:07.505117 10042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.130@KRBTEST.COM'} at 127.11.137.130:57337
WARNING: no policy specified for kudu/127.11.137.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
Entry for principal kudu/127.11.137.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab.
I20260807 06:47:07.529686 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42189
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:07.612617 10516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:07.612818 10516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:07.612840 10516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:07.614024 10516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:07.614064 10516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:07.614090 10516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:47:07.615454 10516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.131.keytab
--principal=kudu/127.11.137.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:42189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:07.615635 10516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:07.615813 10516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:07.620788 10527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.620827 10516 server_base.cc:1034] running on GCE node
W20260807 06:47:07.620889 10526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:07.620800 10529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:07.621160 10516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:07.621470 10516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:07.622642 10516 hybrid_clock.cc:648] HybridClock initialized: now 1786085227622621 us; error 33 us; skew 500 ppm
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:07.625267 10516 init.cc:377] Logged in from keytab as kudu/127.11.137.131@KRBTEST.COM (short username kudu)
I20260807 06:47:07.625684 10516 webserver.cc:460] Webserver started at http://127.11.137.131:42259/ using document root <none> and password file <none>
I20260807 06:47:07.625898 10516 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:07.625944 10516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:07.626094 10516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:07.627132 10516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "6a6caf37c01e4b27909b6586ac28487f"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "f8c27ec3abf6c4884255807c8323d2d7"
server_key_iv: "4fce0b264fe3fb9f7cb33e4aa43fb727"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.627492 10516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "6a6caf37c01e4b27909b6586ac28487f"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "f8c27ec3abf6c4884255807c8323d2d7"
server_key_iv: "4fce0b264fe3fb9f7cb33e4aa43fb727"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.628780 10516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:07.629601 10541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.629794 10516 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:47:07.629889 10516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "6a6caf37c01e4b27909b6586ac28487f"
format_stamp: "Formatted at 2026-08-07 06:47:07 on dist-test-slave-8hhm"
server_key: "f8c27ec3abf6c4884255807c8323d2d7"
server_key_iv: "4fce0b264fe3fb9f7cb33e4aa43fb727"
server_key_version: "encryptionkey@0"
I20260807 06:47:07.629966 10516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:07.652251 10516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:07.654314 10516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:07.654464 10516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:07.654717 10516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:07.655055 10516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:07.655119 10516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.655164 10516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:07.655192 10516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:07.661123 10516 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:35471
I20260807 06:47:07.661203 10704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:35471 every 8 connection(s)
I20260807 06:47:07.661588 10516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:47:07.664970 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 10516
I20260807 06:47:07.665037 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:47:07.665256 11814 external_mini_cluster.cc:1428] Setting key d2e854e981dceea2687faa56a909f8fd
Aug 07 06:47:07 dist-test-slave-8hhm krb5kdc[9976](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.131@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:07.671473 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.662365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:50403 (local address 127.11.137.190:42189)
0807 06:47:07.662409 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.662411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.662597 (+ 186us) server_negotiation.cc:407] Connection header received
0807 06:47:07.663172 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.663174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.663188 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.663253 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:07.664236 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.664745 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.666133 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.666341 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.666427 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.668492 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:07.668493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:07.668494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:07.668501 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:07.669761 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.670216 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.670217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.670218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.670295 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.670647 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.670648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.670648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.670834 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:07.670943 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.671284 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.671400 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:47:07.671516 10707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.662319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:42189 (local address 127.11.137.131:50403)
0807 06:47:07.662464 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.662512 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.663043 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.663330 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.663334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.663922 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:07.664129 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.664134 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.664849 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.664850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.666021 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.666025 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.666441 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.666442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.666579 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.667022 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:07.667029 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:07.668391 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:07.669851 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:07.669857 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:07.669860 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:07.670096 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:07.670378 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:07.670383 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:07.670384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:07.670538 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:07.670954 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:07.670959 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:07.671119 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.671228 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.671350 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260807 06:47:07.672027 10705 heartbeater.cc:347] Connected to a master server at 127.11.137.190:42189
I20260807 06:47:07.672122 10705 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:07.672272 10705 heartbeater.cc:511] Master 127.11.137.190:42189 requested a full tablet report, sending...
I20260807 06:47:07.672636 10042 ts_manager.cc:194] Registered new tserver with Master: 6a6caf37c01e4b27909b6586ac28487f (127.11.137.131:35471)
I20260807 06:47:07.672971 10042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.137.131@KRBTEST.COM'} at 127.11.137.131:50403
I20260807 06:47:07.676827 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:47:07.684263 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.678233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37842 (local address 127.11.137.190:42189)
0807 06:47:07.678288 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.678290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.678413 (+ 123us) server_negotiation.cc:407] Connection header received
0807 06:47:07.678492 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.678493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.678502 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.678558 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:07.679101 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.679566 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.680295 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.680495 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.680571 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.681868 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:07.681869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:07.681869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:07.681876 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:07.683068 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.683420 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.683421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.683421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.683477 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:07.683688 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:07.683689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:07.683690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:07.683844 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:07.683951 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.684082 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.684161 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:47:07.685721 10042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:47:07.687377 10042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:47:07.694242 10719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.689778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:35471 (local address 127.0.0.1:54858)
0807 06:47:07.690132 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.690177 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.690248 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.690607 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.690608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.690611 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.690699 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.690701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.692032 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.692033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.693007 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.693010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.693951 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.693952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.694009 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.694020 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.694097 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.694165 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":75,"threads_started":1}
I20260807 06:47:07.694262 10723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.689883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54858 (local address 127.11.137.131:35471)
0807 06:47:07.690432 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.690441 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.690450 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:07.690503 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.690505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.690522 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.690611 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.690789 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.691920 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.693100 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.693866 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.693949 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.694006 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.694117 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.694164 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":108,"threads_started":1}
I20260807 06:47:07.694379 10724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.689778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:37379 (local address 127.0.0.1:53672)
0807 06:47:07.690133 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.690177 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.690248 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.690604 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.690607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.690610 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.690679 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.690682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.692014 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.692015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.693273 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.693277 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.694165 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.694166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.694222 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.694225 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.694278 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.694318 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":75,"thread_start_us":64,"threads_started":1}
I20260807 06:47:07.695042 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.689900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53672 (local address 127.11.137.129:37379)
0807 06:47:07.690129 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.690135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.690343 (+ 208us) server_negotiation.cc:407] Connection header received
0807 06:47:07.690392 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.690412 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.690431 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.690503 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.690748 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.691909 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.693377 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.694077 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.694150 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.694198 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.694926 (+ 728us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.694981 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":88,"threads_started":1}
I20260807 06:47:07.695431 10721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.689988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40135 (local address 127.0.0.1:35498)
0807 06:47:07.690198 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.690211 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.690273 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.690992 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.690993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.690995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.691042 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.691044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.691895 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.691896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.693282 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.693284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.695195 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.695196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.695256 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.695261 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.695310 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.695354 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":67,"thread_start_us":76,"threads_started":1}
I20260807 06:47:07.695370 10607 tablet_service.cc:1467] Processing CreateTablet for tablet 694507aa8a324eea95cf913ce3897f9d (DEFAULT_TABLE table=test-table [id=2690115283ac436c8fedca0e13e47426]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:07.695729 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.690155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35498 (local address 127.11.137.130:40135)
0807 06:47:07.690830 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.690840 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.690848 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:47:07.690878 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.690879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.690891 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.690981 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.691099 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.691784 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.694237 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.695039 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.695110 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.695157 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.695539 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.695585 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":95,"threads_started":1}
I20260807 06:47:07.695761 10607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694507aa8a324eea95cf913ce3897f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:07.695715 10221 tablet_service.cc:1467] Processing CreateTablet for tablet 694507aa8a324eea95cf913ce3897f9d (DEFAULT_TABLE table=test-table [id=2690115283ac436c8fedca0e13e47426]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:07.696076 10221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694507aa8a324eea95cf913ce3897f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:07.696365 10415 tablet_service.cc:1467] Processing CreateTablet for tablet 694507aa8a324eea95cf913ce3897f9d (DEFAULT_TABLE table=test-table [id=2690115283ac436c8fedca0e13e47426]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:07.696693 10415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694507aa8a324eea95cf913ce3897f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:07.698431 10726 tablet_bootstrap.cc:492] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Bootstrap starting.
I20260807 06:47:07.698964 10726 tablet_bootstrap.cc:654] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:07.699416 10726 log.cc:824] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:07.699491 10727 tablet_bootstrap.cc:492] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: Bootstrap starting.
I20260807 06:47:07.700098 10727 tablet_bootstrap.cc:654] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:07.700213 10729 tablet_bootstrap.cc:492] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Bootstrap starting.
I20260807 06:47:07.700702 10727 log.cc:824] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:07.700941 10729 tablet_bootstrap.cc:654] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:07.701514 10727 tablet_bootstrap.cc:492] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: No bootstrap required, opened a new log
I20260807 06:47:07.701599 10726 tablet_bootstrap.cc:492] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: No bootstrap required, opened a new log
I20260807 06:47:07.701602 10729 log.cc:824] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:07.701623 10727 ts_tablet_manager.cc:1397] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:07.701676 10726 ts_tablet_manager.cc:1397] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 06:47:07.702397 10729 tablet_bootstrap.cc:492] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: No bootstrap required, opened a new log
I20260807 06:47:07.702472 10729 ts_tablet_manager.cc:1397] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:07.703302 10727 raft_consensus.cc:348] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.703500 10727 raft_consensus.cc:374] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:07.703548 10727 raft_consensus.cc:729] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb0c2974e67f41f39f644bc9ad826324, State: Initialized, Role: FOLLOWER
I20260807 06:47:07.703666 10727 consensus_queue.cc:260] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.703771 10726 raft_consensus.cc:348] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.703941 10726 raft_consensus.cc:374] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:07.703949 10727 ts_tablet_manager.cc:1428] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:07.703975 10726 raft_consensus.cc:729] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a6caf37c01e4b27909b6586ac28487f, State: Initialized, Role: FOLLOWER
I20260807 06:47:07.704087 10324 heartbeater.cc:503] Master 127.11.137.190:42189 was elected leader, sending a full tablet report...
I20260807 06:47:07.704099 10726 consensus_queue.cc:260] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.704409 10726 ts_tablet_manager.cc:1428] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:47:07.704439 10705 heartbeater.cc:503] Master 127.11.137.190:42189 was elected leader, sending a full tablet report...
I20260807 06:47:07.704833 10729 raft_consensus.cc:348] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.704998 10729 raft_consensus.cc:374] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:07.705040 10729 raft_consensus.cc:729] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f6cca66052488fbc2e501a44f77bfb, State: Initialized, Role: FOLLOWER
I20260807 06:47:07.705382 10729 consensus_queue.cc:260] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.705701 10729 ts_tablet_manager.cc:1428] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:47:07.705825 10509 heartbeater.cc:503] Master 127.11.137.190:42189 was elected leader, sending a full tablet report...
W20260807 06:47:07.744661 10510 tablet.cc:2369] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:47:07.825525 10325 tablet.cc:2369] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:47:07.837009 10733 raft_consensus.cc:482] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:07.837170 10733 raft_consensus.cc:504] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.837613 10733 leader_election.cc:288] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb0c2974e67f41f39f644bc9ad826324 (127.11.137.129:37379), 30f6cca66052488fbc2e501a44f77bfb (127.11.137.130:40135)
I20260807 06:47:07.838224 10732 raft_consensus.cc:482] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:07.838333 10732 raft_consensus.cc:504] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.838646 10732 leader_election.cc:288] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a6caf37c01e4b27909b6586ac28487f (127.11.137.131:35471), 30f6cca66052488fbc2e501a44f77bfb (127.11.137.130:40135)
I20260807 06:47:07.841434 10707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.837803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:37379 (local address 127.11.137.131:36973)
0807 06:47:07.837862 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.837875 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.837919 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.838109 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.838110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.838112 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.838190 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.838191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.839165 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.839166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.840332 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.840334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.841196 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.841196 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.841296 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.841299 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.841341 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.841369 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 06:47:07.841502 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.837877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:44089 (local address 127.11.137.130:40135)
0807 06:47:07.837924 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.837926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.838136 (+ 210us) server_negotiation.cc:407] Connection header received
0807 06:47:07.838253 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.838254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.838266 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.838320 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.838557 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.839248 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.840435 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.840994 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.841063 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.841072 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.841391 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.841430 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:47:07.841629 10736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.837811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40135 (local address 127.11.137.131:44089)
0807 06:47:07.838078 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.838087 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.838161 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.838368 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.838368 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.838370 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.838463 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.838465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.839328 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.839329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.840332 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.840334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.841108 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.841109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.841182 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.841187 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.841287 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.841333 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":55,"thread_start_us":125,"threads_started":1}
I20260807 06:47:07.841811 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.837843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:36973 (local address 127.11.137.129:37379)
0807 06:47:07.837889 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.837891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.837901 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:47:07.837990 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.837991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.838002 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.838080 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.838270 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.838959 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.840435 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.841092 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.841148 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.841155 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.841709 (+ 554us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.841757 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":102,"server-negotiator.queue_time_us":24}
I20260807 06:47:07.841984 10449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "6a6caf37c01e4b27909b6586ac28487f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f6cca66052488fbc2e501a44f77bfb" is_pre_election: true
I20260807 06:47:07.842046 10251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "6a6caf37c01e4b27909b6586ac28487f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb0c2974e67f41f39f644bc9ad826324" is_pre_election: true
I20260807 06:47:07.842149 10449 raft_consensus.cc:2454] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a6caf37c01e4b27909b6586ac28487f in term 0.
I20260807 06:47:07.842159 10251 raft_consensus.cc:2454] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a6caf37c01e4b27909b6586ac28487f in term 0.
I20260807 06:47:07.842339 10545 leader_election.cc:302] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a6caf37c01e4b27909b6586ac28487f, fb0c2974e67f41f39f644bc9ad826324; no voters:
I20260807 06:47:07.842499 10733 raft_consensus.cc:2781] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:07.842573 10733 raft_consensus.cc:482] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:07.842598 10733 raft_consensus.cc:3037] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:07.842731 10738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.838945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40135 (local address 127.11.137.129:37455)
0807 06:47:07.839128 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.839137 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.839183 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.839435 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.839436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.839438 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.839525 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.839527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.840416 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.840417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.841725 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.841729 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.842443 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.842444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.842514 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.842517 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.842572 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.842612 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":99,"thread_start_us":33,"threads_started":1}
I20260807 06:47:07.842949 10739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.839066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:37455 (local address 127.11.137.130:40135)
0807 06:47:07.839314 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.839316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.839323 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:47:07.839342 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.839343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.839350 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.839412 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.839611 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.840293 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.841830 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.842361 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.842442 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.842450 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.842838 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.842879 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":92,"threads_started":1}
I20260807 06:47:07.843128 10449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "fb0c2974e67f41f39f644bc9ad826324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f6cca66052488fbc2e501a44f77bfb" is_pre_election: true
I20260807 06:47:07.843217 10449 raft_consensus.cc:2454] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb0c2974e67f41f39f644bc9ad826324 in term 0.
I20260807 06:47:07.843395 10156 leader_election.cc:302] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f6cca66052488fbc2e501a44f77bfb, fb0c2974e67f41f39f644bc9ad826324; no voters:
I20260807 06:47:07.843533 10732 raft_consensus.cc:2781] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:07.843587 10732 raft_consensus.cc:482] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:07.843609 10732 raft_consensus.cc:3037] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:07.843641 10733 raft_consensus.cc:504] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.843708 10737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.838782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:35471 (local address 127.11.137.129:43679)
0807 06:47:07.838896 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.838906 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:07.838956 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:07.839463 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:07.839464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:07.839465 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:07.839527 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.839528 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.840414 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.840415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.842681 (+ 2266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:07.842684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.843443 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.843444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:07.843510 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.843514 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:47:07.843571 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 06:47:07.843612 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":68,"thread_start_us":78,"threads_started":1}
I20260807 06:47:07.843748 10723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.838819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:43679 (local address 127.11.137.131:35471)
0807 06:47:07.839044 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.839046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.839053 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:47:07.839074 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.839074 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.839082 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.839127 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:07.839618 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.840325 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.842788 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.843329 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.843402 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.843411 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.843580 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.843624 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204}
I20260807 06:47:07.844028 10251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "6a6caf37c01e4b27909b6586ac28487f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb0c2974e67f41f39f644bc9ad826324"
I20260807 06:47:07.844045 10636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "fb0c2974e67f41f39f644bc9ad826324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a6caf37c01e4b27909b6586ac28487f" is_pre_election: true
I20260807 06:47:07.844146 10636 raft_consensus.cc:2379] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb0c2974e67f41f39f644bc9ad826324 in current term 1: Already voted for candidate 6a6caf37c01e4b27909b6586ac28487f in this term.
I20260807 06:47:07.844341 10449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "6a6caf37c01e4b27909b6586ac28487f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f6cca66052488fbc2e501a44f77bfb"
I20260807 06:47:07.844416 10449 raft_consensus.cc:3037] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:07.844226 10733 leader_election.cc:288] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [CANDIDATE]: Term 1 election: Requested vote from peers fb0c2974e67f41f39f644bc9ad826324 (127.11.137.129:37379), 30f6cca66052488fbc2e501a44f77bfb (127.11.137.130:40135)
I20260807 06:47:07.844549 10732 raft_consensus.cc:504] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.844697 10251 raft_consensus.cc:2379] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a6caf37c01e4b27909b6586ac28487f in current term 1: Already voted for candidate fb0c2974e67f41f39f644bc9ad826324 in this term.
I20260807 06:47:07.844810 10636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "fb0c2974e67f41f39f644bc9ad826324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a6caf37c01e4b27909b6586ac28487f"
I20260807 06:47:07.844699 10732 leader_election.cc:288] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [CANDIDATE]: Term 1 election: Requested vote from peers 6a6caf37c01e4b27909b6586ac28487f (127.11.137.131:35471), 30f6cca66052488fbc2e501a44f77bfb (127.11.137.130:40135)
I20260807 06:47:07.844885 10636 raft_consensus.cc:2379] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fb0c2974e67f41f39f644bc9ad826324 in current term 1: Already voted for candidate 6a6caf37c01e4b27909b6586ac28487f in this term.
I20260807 06:47:07.845320 10448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694507aa8a324eea95cf913ce3897f9d" candidate_uuid: "fb0c2974e67f41f39f644bc9ad826324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f6cca66052488fbc2e501a44f77bfb"
I20260807 06:47:07.845367 10449 raft_consensus.cc:2454] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a6caf37c01e4b27909b6586ac28487f in term 1.
I20260807 06:47:07.845542 10546 leader_election.cc:302] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f6cca66052488fbc2e501a44f77bfb, 6a6caf37c01e4b27909b6586ac28487f; no voters: fb0c2974e67f41f39f644bc9ad826324
I20260807 06:47:07.845634 10733 raft_consensus.cc:2781] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:07.845762 10156 leader_election.cc:302] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb0c2974e67f41f39f644bc9ad826324; no voters: 30f6cca66052488fbc2e501a44f77bfb, 6a6caf37c01e4b27909b6586ac28487f
I20260807 06:47:07.845813 10733 raft_consensus.cc:686] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 LEADER]: Becoming Leader. State: Replica: 6a6caf37c01e4b27909b6586ac28487f, State: Running, Role: LEADER
I20260807 06:47:07.845857 10732 raft_consensus.cc:2726] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 06:47:07.846011 10733 consensus_queue.cc:237] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } }
I20260807 06:47:07.846874 10040 catalog_manager.cc:5495] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a6caf37c01e4b27909b6586ac28487f (127.11.137.131). New cstate: current_term: 1 leader_uuid: "6a6caf37c01e4b27909b6586ac28487f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a6caf37c01e4b27909b6586ac28487f" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 35471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260807 06:47:07.876725 10723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.874657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54872 (local address 127.11.137.131:35471)
0807 06:47:07.874723 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:07.874725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:07.874732 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:47:07.874768 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:07.874769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:07.874786 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:07.874847 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:07.874988 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.875423 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.876098 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:07.876279 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:07.876325 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:07.876450 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:07.876543 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:07.876606 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:07.876624 (+ 18us) server_negotiation.cc:299] Negotiation successful
0807 06:47:07.876654 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:47:07.878579 10251 raft_consensus.cc:1261] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 1 FOLLOWER]: Refusing update from remote peer 6a6caf37c01e4b27909b6586ac28487f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:07.878580 10448 raft_consensus.cc:1261] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 1 FOLLOWER]: Refusing update from remote peer 6a6caf37c01e4b27909b6586ac28487f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:07.878822 10733 consensus_queue.cc:1035] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb0c2974e67f41f39f644bc9ad826324" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:07.878970 10740 consensus_queue.cc:1035] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f6cca66052488fbc2e501a44f77bfb" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:07.882035 10750 mvcc.cc:205] Tried to move back new op lower bound from 7315805093387857920 to 7315805093257949184. Current Snapshot: MvccSnapshot[applied={T|T < 7315805093387857920}]
I20260807 06:47:07.882035 10751 mvcc.cc:205] Tried to move back new op lower bound from 7315805093387857920 to 7315805093257949184. Current Snapshot: MvccSnapshot[applied={T|T < 7315805093387857920}]
I20260807 06:47:07.882171 10748 mvcc.cc:205] Tried to move back new op lower bound from 7315805093387857920 to 7315805093257949184. Current Snapshot: MvccSnapshot[applied={T|T < 7315805093387857920 or (T in {7315805093387857920})}]
I20260807 06:47:07.883750 10040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:07.883864 10040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:07.884629 10040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ceb890951d3d4e6cb611ecb4522d2690: Sending DeleteTablet for 3 replicas of tablet 694507aa8a324eea95cf913ce3897f9d
I20260807 06:47:07.884938 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 694507aa8a324eea95cf913ce3897f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:07 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:54858
I20260807 06:47:07.884965 10221 tablet_service.cc:1514] Processing DeleteTablet for tablet 694507aa8a324eea95cf913ce3897f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:07 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:53672
I20260807 06:47:07.884975 10415 tablet_service.cc:1514] Processing DeleteTablet for tablet 694507aa8a324eea95cf913ce3897f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:07 UTC) from {username='kudu', principal='kudu/127.11.137.190@KRBTEST.COM'} at 127.0.0.1:35498
I20260807 06:47:07.885167 10760 tablet_replica.cc:330] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: stopping tablet replica
I20260807 06:47:07.885295 10760 raft_consensus.cc:2229] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:47:07.885326 10761 tablet_replica.cc:330] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324: stopping tablet replica
I20260807 06:47:07.885371 10760 raft_consensus.cc:2258] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:07.885414 10761 raft_consensus.cc:2229] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:07.885506 10761 raft_consensus.cc:2258] T 694507aa8a324eea95cf913ce3897f9d P fb0c2974e67f41f39f644bc9ad826324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:07.885507 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 10127
I20260807 06:47:07.888432 10762 tablet_replica.cc:330] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: stopping tablet replica
I20260807 06:47:07.888549 10762 raft_consensus.cc:2229] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:07.888688 10762 raft_consensus.cc:2258] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:07.892827 10762 ts_tablet_manager.cc:1905] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:07.895576 10762 ts_tablet_manager.cc:1918] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:07.895665 10762 log.cc:1196] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/694507aa8a324eea95cf913ce3897f9d
I20260807 06:47:07.896014 10762 ts_tablet_manager.cc:1939] T 694507aa8a324eea95cf913ce3897f9d P 30f6cca66052488fbc2e501a44f77bfb: Deleting consensus metadata
I20260807 06:47:07.901332 10021 catalog_manager.cc:4841] TS 30f6cca66052488fbc2e501a44f77bfb (127.11.137.130:40135): tablet 694507aa8a324eea95cf913ce3897f9d (table test-table [id=2690115283ac436c8fedca0e13e47426]) successfully deleted
I20260807 06:47:07.905977 10760 ts_tablet_manager.cc:1905] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:07.907389 10760 ts_tablet_manager.cc:1918] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:07.907452 10760 log.cc:1196] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/694507aa8a324eea95cf913ce3897f9d
I20260807 06:47:07.907684 10760 ts_tablet_manager.cc:1939] T 694507aa8a324eea95cf913ce3897f9d P 6a6caf37c01e4b27909b6586ac28487f: Deleting consensus metadata
I20260807 06:47:07.908149 10021 catalog_manager.cc:4841] TS 6a6caf37c01e4b27909b6586ac28487f (127.11.137.131:35471): tablet 694507aa8a324eea95cf913ce3897f9d (table test-table [id=2690115283ac436c8fedca0e13e47426]) successfully deleted
W20260807 06:47:07.912604 10019 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:37379 (error 108)
I20260807 06:47:07.913264 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 10330
I20260807 06:47:07.913280 10721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:07.913105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:37379 (local address 127.0.0.1:53684)
0807 06:47:07.913163 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:07.913205 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:37379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 06:47:07.916381 10019 catalog_manager.cc:4584] TS fb0c2974e67f41f39f644bc9ad826324 (127.11.137.129:37379): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 694507aa8a324eea95cf913ce3897f9d: Network error: Client connection negotiation failed: client connection to 127.11.137.129:37379: connect: Connection refused (error 111)
I20260807 06:47:07.926030 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 10516
I20260807 06:47:07.934433 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 9998
2026-08-07T06:47:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2332 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T06:47:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:07Z Disabled control of system clock
I20260807 06:47:07.969800 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:44857
--webserver_interface=127.11.137.190
--webserver_port=0
--builtin_ntp_servers=127.11.137.148:46303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:44857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:08.052481 10771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:08.052707 10771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:08.052729 10771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:08.053968 10771 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:08.054014 10771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:08.054028 10771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:08.054040 10771 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:08.054093 10771 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:08.055437 10771 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:44857
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:44857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:08.055706 10771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:08.056008 10771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:08.060899 10785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.061074 10771 server_base.cc:1034] running on GCE node
W20260807 06:47:08.060958 10779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:08.060937 10778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.061466 10771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:08.061796 10771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:08.062954 10771 hybrid_clock.cc:648] HybridClock initialized: now 1786085228062942 us; error 29 us; skew 500 ppm
I20260807 06:47:08.064193 10771 webserver.cc:460] Webserver started at http://127.11.137.190:45897/ using document root <none> and password file <none>
I20260807 06:47:08.064436 10771 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:08.064483 10771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:08.064631 10771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:08.065780 10771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "8513a1a52e094313bbbd38fb0130f138"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "51664aa43fbb1845a9bd4268c6b1f17d"
server_key_iv: "10b1d6e3fff1b9314b0c92a207500f9e"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.066144 10771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "8513a1a52e094313bbbd38fb0130f138"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "51664aa43fbb1845a9bd4268c6b1f17d"
server_key_iv: "10b1d6e3fff1b9314b0c92a207500f9e"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.067533 10771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 06:47:08.068264 10797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.068444 10771 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.068554 10771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "8513a1a52e094313bbbd38fb0130f138"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "51664aa43fbb1845a9bd4268c6b1f17d"
server_key_iv: "10b1d6e3fff1b9314b0c92a207500f9e"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.068629 10771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:08.082155 10771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:08.082504 10771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:08.082659 10771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:08.086802 10771 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:44857
I20260807 06:47:08.086838 10871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:44857 every 8 connection(s)
I20260807 06:47:08.087203 10771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:08.088220 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:08.090638 10873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138: Bootstrap starting.
I20260807 06:47:08.091184 10873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:08.091421 10873 log.cc:824] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:08.092110 10873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138: No bootstrap required, opened a new log
I20260807 06:47:08.093690 10873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8513a1a52e094313bbbd38fb0130f138" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44857 } }
I20260807 06:47:08.093835 10873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:08.093876 10873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8513a1a52e094313bbbd38fb0130f138, State: Initialized, Role: FOLLOWER
I20260807 06:47:08.094018 10873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8513a1a52e094313bbbd38fb0130f138" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44857 } }
I20260807 06:47:08.094103 10873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:08.094126 10873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:08.094156 10873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:08.094659 10873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8513a1a52e094313bbbd38fb0130f138" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44857 } }
I20260807 06:47:08.094777 10873 leader_election.cc:302] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8513a1a52e094313bbbd38fb0130f138; no voters:
I20260807 06:47:08.094832 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 10771
I20260807 06:47:08.094925 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:08.094964 10873 leader_election.cc:288] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:08.095043 10877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:08.095206 11814 external_mini_cluster.cc:1428] Setting key 7b4c608e1591326f83976842ec9bdb57
I20260807 06:47:08.095252 10873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:08.095253 10877 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [term 1 LEADER]: Becoming Leader. State: Replica: 8513a1a52e094313bbbd38fb0130f138, State: Running, Role: LEADER
I20260807 06:47:08.095502 10877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8513a1a52e094313bbbd38fb0130f138" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44857 } }
I20260807 06:47:08.095901 10883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8513a1a52e094313bbbd38fb0130f138. Latest consensus state: current_term: 1 leader_uuid: "8513a1a52e094313bbbd38fb0130f138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8513a1a52e094313bbbd38fb0130f138" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44857 } } }
I20260807 06:47:08.095984 10878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8513a1a52e094313bbbd38fb0130f138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8513a1a52e094313bbbd38fb0130f138" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44857 } } }
I20260807 06:47:08.096078 10883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:08.096089 10878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:08.096429 10893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:08.096997 10893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:08.098588 10893 catalog_manager.cc:1347] Generated new cluster ID: 0d3ad1ab32a54aadaa1992442482910f
I20260807 06:47:08.098641 10893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:08.102299 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.095857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50590 (local address 127.11.137.190:44857)
0807 06:47:08.096374 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.096385 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.096429 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:47:08.096570 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.096578 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.096656 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.097139 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:08.097258 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.098657 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.099785 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.100492 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.100636 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.101411 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:08.101416 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:08.101417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:08.101646 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:08.101691 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:08.101706 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:08.101780 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.101863 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.102085 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":81,"threads_started":1}
I20260807 06:47:08.133364 10893 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:08.134138 10893 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:08.143098 10893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138: Generated new TSK 0
I20260807 06:47:08.143301 10893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:08.153949 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.129:0
--local_ip_for_outbound_sockets=127.11.137.129
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:44857
--builtin_ntp_servers=127.11.137.148:46303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:08.239671 10906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:08.239904 10906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:08.239948 10906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:08.241281 10906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:08.241325 10906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:08.241354 10906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.129
I20260807 06:47:08.242920 10906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.137.129
--webserver_port=0
--tserver_master_addrs=127.11.137.190:44857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.129
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:08.243199 10906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:08.243527 10906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:08.249579 10915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:08.249606 10918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.249734 10906 server_base.cc:1034] running on GCE node
W20260807 06:47:08.249908 10914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.250167 10906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:08.250483 10906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:08.251648 10906 hybrid_clock.cc:648] HybridClock initialized: now 1786085228251629 us; error 33 us; skew 500 ppm
I20260807 06:47:08.253019 10906 webserver.cc:460] Webserver started at http://127.11.137.129:43157/ using document root <none> and password file <none>
I20260807 06:47:08.253350 10906 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:08.253425 10906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:08.253576 10906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:08.254693 10906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data/instance:
uuid: "52bad7df83644a0a9cabf5f6e5c7cc61"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "636b4f7f709fdf136f5e0e8e7ead9d8b"
server_key_iv: "200433a32eb21c9cc8004fec8b4fedfb"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.255089 10906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance:
uuid: "52bad7df83644a0a9cabf5f6e5c7cc61"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "636b4f7f709fdf136f5e0e8e7ead9d8b"
server_key_iv: "200433a32eb21c9cc8004fec8b4fedfb"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.256426 10906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:08.257158 10929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.257413 10906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:08.257507 10906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal
uuid: "52bad7df83644a0a9cabf5f6e5c7cc61"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "636b4f7f709fdf136f5e0e8e7ead9d8b"
server_key_iv: "200433a32eb21c9cc8004fec8b4fedfb"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.257567 10906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:08.265347 10906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:08.265573 10906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:08.265666 10906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:08.265841 10906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:08.266099 10906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:08.266136 10906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.266157 10906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:08.266170 10906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.272189 10906 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.129:44215
I20260807 06:47:08.272267 11104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.129:44215 every 8 connection(s)
I20260807 06:47:08.272631 10906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/data/info.pb
I20260807 06:47:08.277585 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.273407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.129:39081 (local address 127.11.137.190:44857)
0807 06:47:08.273481 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.273484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.273704 (+ 220us) server_negotiation.cc:407] Connection header received
0807 06:47:08.274224 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.274225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.274239 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.274294 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:08.274919 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.275410 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.276330 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.276511 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.276560 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.277366 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:08.277368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:08.277368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:08.277372 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:08.277387 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:08.277391 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:08.277441 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.277491 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.277522 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:47:08.277789 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.273389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:44857 (local address 127.11.137.129:39081)
0807 06:47:08.273586 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.273619 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.274132 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.274348 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.274351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.274359 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:08.274850 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.274855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.275491 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.275492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.276255 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.276257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.276584 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.276585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.276690 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.277161 (+ 471us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:08.277162 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:08.277196 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:08.277277 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:08.277443 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:08.277445 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:08.277448 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.277494 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.277571 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":111,"threads_started":1}
I20260807 06:47:08.278277 11105 heartbeater.cc:347] Connected to a master server at 127.11.137.190:44857
I20260807 06:47:08.278391 11105 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:08.278580 11105 heartbeater.cc:511] Master 127.11.137.190:44857 requested a full tablet report, sending...
I20260807 06:47:08.279083 10819 ts_manager.cc:194] Registered new tserver with Master: 52bad7df83644a0a9cabf5f6e5c7cc61 (127.11.137.129:44215)
I20260807 06:47:08.279644 10819 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.129:39081
I20260807 06:47:08.279848 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 10906
I20260807 06:47:08.279958 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-0/wal/instance
I20260807 06:47:08.280189 11814 external_mini_cluster.cc:1428] Setting key 494165555ab5f539457424a45487b7a1
I20260807 06:47:08.281031 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.130:0
--local_ip_for_outbound_sockets=127.11.137.130
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:44857
--builtin_ntp_servers=127.11.137.148:46303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:47:08.364379 11109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:08.364583 11109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:08.364604 11109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:08.365694 11109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:08.365726 11109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:08.365751 11109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.130
I20260807 06:47:08.367007 11109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.137.130
--webserver_port=0
--tserver_master_addrs=127.11.137.190:44857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.130
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:08.367193 11109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:08.367426 11109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:08.372514 11120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:08.372514 11122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:08.372555 11117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.372764 11109 server_base.cc:1034] running on GCE node
I20260807 06:47:08.373020 11109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:08.373322 11109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:08.374475 11109 hybrid_clock.cc:648] HybridClock initialized: now 1786085228374454 us; error 36 us; skew 500 ppm
I20260807 06:47:08.375824 11109 webserver.cc:460] Webserver started at http://127.11.137.130:39725/ using document root <none> and password file <none>
I20260807 06:47:08.376077 11109 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:08.376127 11109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:08.376292 11109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:08.377461 11109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data/instance:
uuid: "50da536a078d4f4e99f8e0b87d4d26a8"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "4fe80194411f5c42f5dcc67aed96ed8d"
server_key_iv: "fa5f55a2fd1f81165c5b96f38aa690a1"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.377846 11109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance:
uuid: "50da536a078d4f4e99f8e0b87d4d26a8"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "4fe80194411f5c42f5dcc67aed96ed8d"
server_key_iv: "fa5f55a2fd1f81165c5b96f38aa690a1"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.379138 11109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:08.379848 11128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.380028 11109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:08.380124 11109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal
uuid: "50da536a078d4f4e99f8e0b87d4d26a8"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "4fe80194411f5c42f5dcc67aed96ed8d"
server_key_iv: "fa5f55a2fd1f81165c5b96f38aa690a1"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.380200 11109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:08.405766 11109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:08.406113 11109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:08.406282 11109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:08.406555 11109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:08.406916 11109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:08.406986 11109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.407032 11109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:08.407054 11109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.412925 11109 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.130:40389
I20260807 06:47:08.412968 11286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.130:40389 every 8 connection(s)
I20260807 06:47:08.413374 11109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/data/info.pb
I20260807 06:47:08.416572 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11109
I20260807 06:47:08.416709 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal/instance
I20260807 06:47:08.416903 11814 external_mini_cluster.cc:1428] Setting key 65c22bbe6b357668dff6ec50c7bcc7a7
I20260807 06:47:08.417958 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.137.131:0
--local_ip_for_outbound_sockets=127.11.137.131
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:44857
--builtin_ntp_servers=127.11.137.148:46303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:47:08.419167 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.414172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:46075 (local address 127.11.137.190:44857)
0807 06:47:08.414242 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.414244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.414497 (+ 253us) server_negotiation.cc:407] Connection header received
0807 06:47:08.415060 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.415068 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.415081 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.415156 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:08.415887 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.416390 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.417619 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.417828 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.417914 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.418890 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:08.418892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:08.418892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:08.418897 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:08.418912 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:08.418916 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:08.418970 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.419053 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.419089 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:47:08.419413 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.414180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:44857 (local address 127.11.137.130:46075)
0807 06:47:08.414363 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.414399 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.414928 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.415235 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.415238 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.415247 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:08.415765 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.415769 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.416507 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.416508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.417520 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.417523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.417928 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.417929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.418089 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.418730 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:08.418731 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:08.418759 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:08.418782 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:08.418974 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:08.418979 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:08.418982 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.419056 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.419159 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260807 06:47:08.419993 11288 heartbeater.cc:347] Connected to a master server at 127.11.137.190:44857
I20260807 06:47:08.420109 11288 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:08.420317 11288 heartbeater.cc:511] Master 127.11.137.190:44857 requested a full tablet report, sending...
I20260807 06:47:08.420719 10819 ts_manager.cc:194] Registered new tserver with Master: 50da536a078d4f4e99f8e0b87d4d26a8 (127.11.137.130:40389)
I20260807 06:47:08.421264 10819 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.130:46075
W20260807 06:47:08.500638 11291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:08.500824 11291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:08.500845 11291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:08.501940 11291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:08.501972 11291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:08.501995 11291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.137.131
I20260807 06:47:08.503212 11291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.137.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.137.131
--webserver_port=0
--tserver_master_addrs=127.11.137.190:44857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.137.131
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:08.503383 11291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:08.503667 11291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:08.508693 11306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:08.508638 11296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.508685 11291 server_base.cc:1034] running on GCE node
W20260807 06:47:08.508656 11297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:08.509042 11291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:08.509348 11291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:08.510505 11291 hybrid_clock.cc:648] HybridClock initialized: now 1786085228510481 us; error 41 us; skew 500 ppm
I20260807 06:47:08.511750 11291 webserver.cc:460] Webserver started at http://127.11.137.131:43823/ using document root <none> and password file <none>
I20260807 06:47:08.512017 11291 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:08.512064 11291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:08.512217 11291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:08.513319 11291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data/instance:
uuid: "f2a548f199f34df692605077dc82117b"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "5aad4dcba8b69b50d9e6e00673fd6c35"
server_key_iv: "344d9e81ff25de7ea248a752c68f8890"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.513679 11291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance:
uuid: "f2a548f199f34df692605077dc82117b"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "5aad4dcba8b69b50d9e6e00673fd6c35"
server_key_iv: "344d9e81ff25de7ea248a752c68f8890"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.515057 11291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 06:47:08.515775 11313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.515936 11291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.516036 11291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal
uuid: "f2a548f199f34df692605077dc82117b"
format_stamp: "Formatted at 2026-08-07 06:47:08 on dist-test-slave-8hhm"
server_key: "5aad4dcba8b69b50d9e6e00673fd6c35"
server_key_iv: "344d9e81ff25de7ea248a752c68f8890"
server_key_version: "encryptionkey@0"
I20260807 06:47:08.516119 11291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:08.534226 11291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:08.534505 11291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:08.534659 11291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:08.534891 11291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:47:08.535223 11291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:47:08.535277 11291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.535310 11291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:47:08.535339 11291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:08.541057 11291 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.131:38921
I20260807 06:47:08.541132 11481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.131:38921 every 8 connection(s)
I20260807 06:47:08.541479 11291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/data/info.pb
I20260807 06:47:08.544234 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11291
I20260807 06:47:08.544366 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal/instance
I20260807 06:47:08.544579 11814 external_mini_cluster.cc:1428] Setting key 708767e1829cb17af3ccca2c59d7461f
I20260807 06:47:08.546689 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.542216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.131:55659 (local address 127.11.137.190:44857)
0807 06:47:08.542283 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.542285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.542497 (+ 212us) server_negotiation.cc:407] Connection header received
0807 06:47:08.542991 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.542992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.543002 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.543073 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:08.543693 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.544208 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.545497 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.545716 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.545767 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.546481 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:08.546483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:08.546483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:08.546487 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:08.546501 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:08.546505 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:08.546560 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.546609 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.546633 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:47:08.546907 11490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.542205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:44857 (local address 127.11.137.131:55659)
0807 06:47:08.542371 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.542410 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.542899 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.543127 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.543130 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.543138 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:08.543618 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.543622 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.544310 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.544312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.545419 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.545423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.545790 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.545791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.545902 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.546359 (+ 457us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:47:08.546360 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:08.546385 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:47:08.546405 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:08.546562 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:08.546564 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:08.546566 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.546611 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.546685 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260807 06:47:08.547389 11483 heartbeater.cc:347] Connected to a master server at 127.11.137.190:44857
I20260807 06:47:08.547494 11483 heartbeater.cc:464] Registering TS with master...
I20260807 06:47:08.547680 11483 heartbeater.cc:511] Master 127.11.137.190:44857 requested a full tablet report, sending...
I20260807 06:47:08.548067 10819 ts_manager.cc:194] Registered new tserver with Master: f2a548f199f34df692605077dc82117b (127.11.137.131:38921)
I20260807 06:47:08.548445 10819 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.137.131:55659
I20260807 06:47:08.556466 11814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:47:08.560701 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.557972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.11.137.190:44857)
0807 06:47:08.558020 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.558023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.558154 (+ 131us) server_negotiation.cc:407] Connection header received
0807 06:47:08.558205 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.558206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.558216 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.558252 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:08.558373 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.558825 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.559532 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.559781 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.559826 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.560435 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:08.560436 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:08.560436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:08.560440 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:08.560455 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:08.560459 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:08.560502 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.560574 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.560620 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:47:08.562250 10819 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:47:08.563784 10819 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:47:08.570363 11498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.566022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44215 (local address 127.0.0.1:56958)
0807 06:47:08.566242 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.566284 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.566362 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.566661 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.566664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.566665 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:08.566710 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.566711 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.568017 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.568018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.569170 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.569173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.570056 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.570057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.570143 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.570158 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.570228 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.570284 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":43,"thread_start_us":87,"threads_started":1}
I20260807 06:47:08.570390 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.566227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56958 (local address 127.11.137.129:44215)
0807 06:47:08.566431 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.566436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.566448 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:47:08.566492 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.566494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.566510 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.566585 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:08.566790 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.567896 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.569305 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.569962 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.570041 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.570137 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.570252 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.570293 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":129,"threads_started":1}
I20260807 06:47:08.570681 11502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.566232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50756 (local address 127.11.137.130:40389)
0807 06:47:08.566946 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.566949 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.566958 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:08.566999 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.567001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.567012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.567099 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:08.567207 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.567855 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.569514 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.570080 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.570146 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.570244 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.570563 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.570608 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":108,"threads_started":1}
I20260807 06:47:08.570500 11499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.566032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.130:40389 (local address 127.0.0.1:50756)
0807 06:47:08.566469 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.566478 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.566518 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.567098 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.567099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.567100 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:08.567145 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.567147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.567967 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.567968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.569417 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.569420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.570279 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.570280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.570334 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.570337 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.570383 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.570420 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":35,"thread_start_us":125,"threads_started":1}
I20260807 06:47:08.570760 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.566023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:38921 (local address 127.0.0.1:53068)
0807 06:47:08.566446 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.566457 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.566510 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.566822 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.566822 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.566824 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:08.566857 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.566859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.568076 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.568077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.569506 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.569508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.570512 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.570513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.570578 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.570581 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.570617 (+ 36us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.570676 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":43,"thread_start_us":73,"threads_started":1}
I20260807 06:47:08.570997 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.566467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53068 (local address 127.11.137.131:38921)
0807 06:47:08.566682 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.566687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.566696 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:08.566735 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.566737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.566751 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.566825 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:08.566937 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.567999 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.569598 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.570291 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.570361 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.570439 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.570863 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.570907 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":82,"threads_started":1}
I20260807 06:47:08.571545 11199 tablet_service.cc:1467] Processing CreateTablet for tablet 511346d473a04f67882c3292477011c0 (DEFAULT_TABLE table=test-table [id=991036ed42954ff3a5ee703e606d9e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:08.571676 11384 tablet_service.cc:1467] Processing CreateTablet for tablet 511346d473a04f67882c3292477011c0 (DEFAULT_TABLE table=test-table [id=991036ed42954ff3a5ee703e606d9e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:08.572000 11199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511346d473a04f67882c3292477011c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:08.572121 11384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511346d473a04f67882c3292477011c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:08.572052 11002 tablet_service.cc:1467] Processing CreateTablet for tablet 511346d473a04f67882c3292477011c0 (DEFAULT_TABLE table=test-table [id=991036ed42954ff3a5ee703e606d9e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:47:08.572376 11002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511346d473a04f67882c3292477011c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:08.574878 11504 tablet_bootstrap.cc:492] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Bootstrap starting.
I20260807 06:47:08.575632 11504 tablet_bootstrap.cc:654] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:08.575613 11505 tablet_bootstrap.cc:492] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Bootstrap starting.
I20260807 06:47:08.575788 11506 tablet_bootstrap.cc:492] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61: Bootstrap starting.
I20260807 06:47:08.576004 11504 log.cc:824] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:08.576390 11505 tablet_bootstrap.cc:654] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:08.576526 11506 tablet_bootstrap.cc:654] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:08.576719 11505 log.cc:824] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:08.576797 11506 log.cc:824] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:08.577008 11504 tablet_bootstrap.cc:492] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: No bootstrap required, opened a new log
I20260807 06:47:08.577081 11504 ts_tablet_manager.cc:1397] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:47:08.577548 11505 tablet_bootstrap.cc:492] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: No bootstrap required, opened a new log
I20260807 06:47:08.577633 11505 ts_tablet_manager.cc:1397] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:47:08.579861 11504 raft_consensus.cc:348] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.580045 11504 raft_consensus.cc:374] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:08.580083 11504 raft_consensus.cc:729] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2a548f199f34df692605077dc82117b, State: Initialized, Role: FOLLOWER
I20260807 06:47:08.580204 11504 consensus_queue.cc:260] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.580251 11505 raft_consensus.cc:348] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.580418 11505 raft_consensus.cc:374] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:08.580462 11505 raft_consensus.cc:729] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da536a078d4f4e99f8e0b87d4d26a8, State: Initialized, Role: FOLLOWER
I20260807 06:47:08.580493 11504 ts_tablet_manager.cc:1428] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260807 06:47:08.580545 11483 heartbeater.cc:503] Master 127.11.137.190:44857 was elected leader, sending a full tablet report...
I20260807 06:47:08.580678 11505 consensus_queue.cc:260] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.580981 11505 ts_tablet_manager.cc:1428] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 06:47:08.580998 11288 heartbeater.cc:503] Master 127.11.137.190:44857 was elected leader, sending a full tablet report...
I20260807 06:47:08.581525 11506 tablet_bootstrap.cc:492] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61: No bootstrap required, opened a new log
I20260807 06:47:08.581635 11506 ts_tablet_manager.cc:1397] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260807 06:47:08.583573 11506 raft_consensus.cc:348] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.583696 11506 raft_consensus.cc:374] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:08.583717 11506 raft_consensus.cc:729] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52bad7df83644a0a9cabf5f6e5c7cc61, State: Initialized, Role: FOLLOWER
I20260807 06:47:08.583825 11506 consensus_queue.cc:260] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.584105 11506 ts_tablet_manager.cc:1428] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 06:47:08.584178 11105 heartbeater.cc:503] Master 127.11.137.190:44857 was elected leader, sending a full tablet report...
W20260807 06:47:08.663947 11289 tablet.cc:2369] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:47:08.698503 11516 raft_consensus.cc:482] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:47:08.698632 11516 raft_consensus.cc:504] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.699076 11516 leader_election.cc:288] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52bad7df83644a0a9cabf5f6e5c7cc61 (127.11.137.129:44215), f2a548f199f34df692605077dc82117b (127.11.137.131:38921)
I20260807 06:47:08.702821 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.699334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:60499 (local address 127.11.137.129:44215)
0807 06:47:08.699386 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.699389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.699398 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:08.699432 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.699433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.699446 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.699510 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:08.699706 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.700438 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.701926 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.702463 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.702533 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.702540 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.702708 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.702748 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 06:47:08.702821 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.699354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.137.130:33381 (local address 127.11.137.131:38921)
0807 06:47:08.699395 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.699397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.699583 (+ 186us) server_negotiation.cc:407] Connection header received
0807 06:47:08.699624 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.699625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.699633 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.699703 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:47:08.699849 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.700516 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.701925 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.702455 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.702533 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.702540 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.702708 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.702749 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:47:08.702831 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.699252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44215 (local address 127.11.137.130:60499)
0807 06:47:08.699313 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.699326 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.699370 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.699540 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.699541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.699543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:08.699619 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.699621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.700521 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.700521 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.701830 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.701833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.702544 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.702545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.702620 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.702626 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.702682 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.702727 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":65}
I20260807 06:47:08.702837 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.699311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.131:38921 (local address 127.11.137.130:33381)
0807 06:47:08.699479 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.699487 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:08.699560 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:08.699723 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:08.699724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:08.699725 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:47:08.699782 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.699783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.700593 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.700594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.701830 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:08.701833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.702546 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.702547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:08.702620 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.702626 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:47:08.702691 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:47:08.702725 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":8,"thread_start_us":108,"threads_started":1}
I20260807 06:47:08.703313 11413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511346d473a04f67882c3292477011c0" candidate_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2a548f199f34df692605077dc82117b" is_pre_election: true
I20260807 06:47:08.703334 11028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511346d473a04f67882c3292477011c0" candidate_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" is_pre_election: true
I20260807 06:47:08.703475 11028 raft_consensus.cc:2454] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da536a078d4f4e99f8e0b87d4d26a8 in term 0.
I20260807 06:47:08.703478 11413 raft_consensus.cc:2454] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da536a078d4f4e99f8e0b87d4d26a8 in term 0.
I20260807 06:47:08.703743 11129 leader_election.cc:302] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da536a078d4f4e99f8e0b87d4d26a8, f2a548f199f34df692605077dc82117b; no voters:
I20260807 06:47:08.703914 11516 raft_consensus.cc:2781] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:47:08.703981 11516 raft_consensus.cc:482] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:47:08.704011 11516 raft_consensus.cc:3037] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:08.704764 11516 raft_consensus.cc:504] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.704919 11516 leader_election.cc:288] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [CANDIDATE]: Term 1 election: Requested vote from peers 52bad7df83644a0a9cabf5f6e5c7cc61 (127.11.137.129:44215), f2a548f199f34df692605077dc82117b (127.11.137.131:38921)
I20260807 06:47:08.705103 11413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511346d473a04f67882c3292477011c0" candidate_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2a548f199f34df692605077dc82117b"
I20260807 06:47:08.705078 11028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511346d473a04f67882c3292477011c0" candidate_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61"
I20260807 06:47:08.705180 11028 raft_consensus.cc:3037] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:08.705199 11413 raft_consensus.cc:3037] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:08.705957 11413 raft_consensus.cc:2454] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da536a078d4f4e99f8e0b87d4d26a8 in term 1.
I20260807 06:47:08.705960 11028 raft_consensus.cc:2454] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da536a078d4f4e99f8e0b87d4d26a8 in term 1.
I20260807 06:47:08.706139 11130 leader_election.cc:302] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da536a078d4f4e99f8e0b87d4d26a8, 52bad7df83644a0a9cabf5f6e5c7cc61; no voters:
I20260807 06:47:08.706251 11516 raft_consensus.cc:2781] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:08.706426 11516 raft_consensus.cc:686] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 1 LEADER]: Becoming Leader. State: Replica: 50da536a078d4f4e99f8e0b87d4d26a8, State: Running, Role: LEADER
I20260807 06:47:08.706548 11516 consensus_queue.cc:237] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } }
I20260807 06:47:08.707451 10819 catalog_manager.cc:5495] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50da536a078d4f4e99f8e0b87d4d26a8 (127.11.137.130). New cstate: current_term: 1 leader_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da536a078d4f4e99f8e0b87d4d26a8" member_type: VOTER last_known_addr { host: "127.11.137.130" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260807 06:47:08.716984 11502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.714951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.11.137.130:40389)
0807 06:47:08.715011 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:08.715012 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:08.715019 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:47:08.715058 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:08.715059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:08.715081 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:08.715139 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:08.715265 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.715684 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.716378 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:08.716545 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:08.716597 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:08.716720 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:08.716808 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:08.716865 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:08.716896 (+ 31us) server_negotiation.cc:299] Negotiation successful
0807 06:47:08.716913 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:47:08.718758 11028 raft_consensus.cc:1261] T 511346d473a04f67882c3292477011c0 P 52bad7df83644a0a9cabf5f6e5c7cc61 [term 1 FOLLOWER]: Refusing update from remote peer 50da536a078d4f4e99f8e0b87d4d26a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:08.718791 11413 raft_consensus.cc:1261] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 1 FOLLOWER]: Refusing update from remote peer 50da536a078d4f4e99f8e0b87d4d26a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:08.719126 11516 consensus_queue.cc:1035] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2a548f199f34df692605077dc82117b" member_type: VOTER last_known_addr { host: "127.11.137.131" port: 38921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:08.719271 11522 consensus_queue.cc:1035] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52bad7df83644a0a9cabf5f6e5c7cc61" member_type: VOTER last_known_addr { host: "127.11.137.129" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:08.721626 11525 mvcc.cc:205] Tried to move back new op lower bound from 7315805096829288448 to 7315805096782729216. Current Snapshot: MvccSnapshot[applied={T|T < 7315805096829288448}]
I20260807 06:47:08.721771 11528 mvcc.cc:205] Tried to move back new op lower bound from 7315805096829288448 to 7315805096782729216. Current Snapshot: MvccSnapshot[applied={T|T < 7315805096829288448}]
I20260807 06:47:08.722127 11530 mvcc.cc:205] Tried to move back new op lower bound from 7315805096829288448 to 7315805096782729216. Current Snapshot: MvccSnapshot[applied={T|T < 7315805096829288448}]
I20260807 06:47:08.724103 10819 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:08.724192 10819 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:47:08.724946 10819 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8513a1a52e094313bbbd38fb0130f138: Sending DeleteTablet for 3 replicas of tablet 511346d473a04f67882c3292477011c0
I20260807 06:47:08.725306 11002 tablet_service.cc:1514] Processing DeleteTablet for tablet 511346d473a04f67882c3292477011c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:08 UTC) from {username='slave'} at 127.0.0.1:56958
I20260807 06:47:08.725317 11384 tablet_service.cc:1514] Processing DeleteTablet for tablet 511346d473a04f67882c3292477011c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:08 UTC) from {username='slave'} at 127.0.0.1:53068
I20260807 06:47:08.725517 11199 tablet_service.cc:1514] Processing DeleteTablet for tablet 511346d473a04f67882c3292477011c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:47:08 UTC) from {username='slave'} at 127.0.0.1:50756
I20260807 06:47:08.725754 11545 tablet_replica.cc:330] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: stopping tablet replica
I20260807 06:47:08.725811 11543 tablet_replica.cc:330] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: stopping tablet replica
I20260807 06:47:08.725893 11545 raft_consensus.cc:2229] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:47:08.725914 11543 raft_consensus.cc:2229] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:47:08.726023 11543 raft_consensus.cc:2258] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:08.726040 11545 raft_consensus.cc:2258] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:47:08.726079 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 10906
I20260807 06:47:08.727097 11543 ts_tablet_manager.cc:1905] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:08.729267 11543 ts_tablet_manager.cc:1918] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:08.729338 11543 log.cc:1196] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-2/wal/wals/511346d473a04f67882c3292477011c0
I20260807 06:47:08.729571 11543 ts_tablet_manager.cc:1939] T 511346d473a04f67882c3292477011c0 P f2a548f199f34df692605077dc82117b: Deleting consensus metadata
I20260807 06:47:08.729938 10800 catalog_manager.cc:4841] TS f2a548f199f34df692605077dc82117b (127.11.137.131:38921): tablet 511346d473a04f67882c3292477011c0 (table test-table [id=991036ed42954ff3a5ee703e606d9e5f]) successfully deleted
I20260807 06:47:08.734365 11545 ts_tablet_manager.cc:1905] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:47:08.736030 11545 ts_tablet_manager.cc:1918] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:47:08.736109 11545 log.cc:1196] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Deleting WAL directory at /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786084979847518-11814-0/minicluster-data/ts-1/wal/wals/511346d473a04f67882c3292477011c0
I20260807 06:47:08.736385 11545 ts_tablet_manager.cc:1939] T 511346d473a04f67882c3292477011c0 P 50da536a078d4f4e99f8e0b87d4d26a8: Deleting consensus metadata
I20260807 06:47:08.736841 10803 catalog_manager.cc:4841] TS 50da536a078d4f4e99f8e0b87d4d26a8 (127.11.137.130:40389): tablet 511346d473a04f67882c3292477011c0 (table test-table [id=991036ed42954ff3a5ee703e606d9e5f]) successfully deleted
W20260807 06:47:08.738863 10802 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.137.129:44215 (error 108)
I20260807 06:47:08.739136 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11109
I20260807 06:47:08.745604 11498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:08.739303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.129:44215 (local address 127.0.0.1:56968)
0807 06:47:08.745512 (+ 6209us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:08.745567 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.129:44215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6181}
W20260807 06:47:08.751688 10802 catalog_manager.cc:4584] TS 52bad7df83644a0a9cabf5f6e5c7cc61 (127.11.137.129:44215): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 511346d473a04f67882c3292477011c0: Network error: Client connection negotiation failed: client connection to 127.11.137.129:44215: connect: Connection refused (error 111)
I20260807 06:47:08.756251 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11291
I20260807 06:47:08.764695 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 10771
2026-08-07T06:47:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (827 ms)
[----------] 6 tests from EncryptionPolicyTest (9491 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:08 dist-test-slave-8hhm krb5kdc[11549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:08 dist-test-slave-8hhm krb5kdc[11549](info): set up 2 sockets
Aug 07 06:47:08 dist-test-slave-8hhm krb5kdc[11549](info): commencing operation
krb5kdc: starting...
W20260807 06:47:10.005417 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:10 dist-test-slave-8hhm krb5kdc[11549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:10.124007 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39593
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:10.206146 11567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:10.206364 11567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:10.206404 11567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:10.207521 11567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:10.207595 11567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:10.207623 11567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:10.207653 11567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:10.207676 11567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:10.209116 11567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39593
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:10.209399 11567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:10.209631 11567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:10.214519 11578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:10.214542 11574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:10.214547 11575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:10.214829 11567 server_base.cc:1034] running on GCE node
I20260807 06:47:10.215055 11567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:10.215346 11567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:10.216485 11567 hybrid_clock.cc:648] HybridClock initialized: now 1786085230216472 us; error 26 us; skew 500 ppm
Aug 07 06:47:10 dist-test-slave-8hhm krb5kdc[11549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085230, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:10.219204 11567 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:10.219633 11567 webserver.cc:460] Webserver started at http://127.0.0.1:44277/ using document root <none> and password file <none>
I20260807 06:47:10.219894 11567 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:10.219957 11567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:10.220137 11567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:10.221163 11567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "4a2c550f4752494fb37b90bc7692f9b1"
format_stamp: "Formatted at 2026-08-07 06:47:10 on dist-test-slave-8hhm"
server_key: "61ecb3859715bb8e9e6a6e61f1cb315e"
server_key_iv: "ea12bbb4fde7682ca1ddc7cb9b7340ba"
server_key_version: "encryptionkey@0"
I20260807 06:47:10.221590 11567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "4a2c550f4752494fb37b90bc7692f9b1"
format_stamp: "Formatted at 2026-08-07 06:47:10 on dist-test-slave-8hhm"
server_key: "61ecb3859715bb8e9e6a6e61f1cb315e"
server_key_iv: "ea12bbb4fde7682ca1ddc7cb9b7340ba"
server_key_version: "encryptionkey@0"
I20260807 06:47:10.222990 11567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:10.223747 11590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:10.223965 11567 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:10.224042 11567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "4a2c550f4752494fb37b90bc7692f9b1"
format_stamp: "Formatted at 2026-08-07 06:47:10 on dist-test-slave-8hhm"
server_key: "61ecb3859715bb8e9e6a6e61f1cb315e"
server_key_iv: "ea12bbb4fde7682ca1ddc7cb9b7340ba"
server_key_version: "encryptionkey@0"
I20260807 06:47:10.224128 11567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:10.240244 11567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:10.242130 11567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:10.242276 11567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:10.246284 11567 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39593
I20260807 06:47:10.246336 11664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39593 every 8 connection(s)
I20260807 06:47:10.246654 11567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:10.247560 11666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:10.249202 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11567
I20260807 06:47:10.249353 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:10.249543 11814 external_mini_cluster.cc:1428] Setting key 4bc699afbd3f91a4b440444bdbe11b74
I20260807 06:47:10.250187 11666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1: Bootstrap starting.
I20260807 06:47:10.250792 11666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:10.251164 11666 log.cc:824] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:10.251962 11666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1: No bootstrap required, opened a new log
I20260807 06:47:10.254180 11666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2c550f4752494fb37b90bc7692f9b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260807 06:47:10.254343 11666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:10.254383 11666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a2c550f4752494fb37b90bc7692f9b1, State: Initialized, Role: FOLLOWER
I20260807 06:47:10.254540 11666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2c550f4752494fb37b90bc7692f9b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260807 06:47:10.254639 11666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:10.254699 11666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:10.254753 11666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:10.255506 11666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2c550f4752494fb37b90bc7692f9b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260807 06:47:10.255633 11666 leader_election.cc:302] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a2c550f4752494fb37b90bc7692f9b1; no voters:
I20260807 06:47:10.255817 11666 leader_election.cc:288] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:10.255878 11672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:10.256037 11672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4a2c550f4752494fb37b90bc7692f9b1, State: Running, Role: LEADER
I20260807 06:47:10.256114 11666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:10.256122 11672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2c550f4752494fb37b90bc7692f9b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260807 06:47:10.256496 11674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a2c550f4752494fb37b90bc7692f9b1. Latest consensus state: current_term: 1 leader_uuid: "4a2c550f4752494fb37b90bc7692f9b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2c550f4752494fb37b90bc7692f9b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } } }
I20260807 06:47:10.256609 11674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [sys.catalog]: This master's current role is: LEADER
Aug 07 06:47:10 dist-test-slave-8hhm krb5kdc[11549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:47:10.256496 11673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a2c550f4752494fb37b90bc7692f9b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2c550f4752494fb37b90bc7692f9b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } } }
I20260807 06:47:10.256786 11673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:10.256906 11683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:10.257443 11683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:10.259426 11683 catalog_manager.cc:1347] Generated new cluster ID: 876c9a26253544f68c7835dce3b46f59
I20260807 06:47:10.259485 11683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:10.261044 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:10.250082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44731 (local address 127.0.0.1:39593)
0807 06:47:10.250252 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:10.250267 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:10.250318 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:47:10.250765 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:10.250772 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:10.250816 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:10.250981 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:10.251813 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:10.252737 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:10.253882 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:10.254272 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:10.254383 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:10.257434 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:10.257440 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:10.257440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:10.257453 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:10.259497 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:10.259903 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:10.259906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:10.259907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:10.260014 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:10.260274 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:10.260275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:10.260275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:10.260505 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:10.260686 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:10.260773 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 06:47:10.260876 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":103,"threads_started":1}
I20260807 06:47:10.262017 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:10.269671 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:10.263521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49437 (local address 127.0.0.1:39593)
0807 06:47:10.263555 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:10.263557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:10.263602 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:47:10.263666 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:10.263667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:10.263676 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:10.263724 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:10.264235 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:10.264724 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:10.265480 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:10.265715 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:10.265789 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:10.266944 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:10.266946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:10.266946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:10.266953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:10.268346 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:10.268724 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:10.268725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:10.268725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:10.268784 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:10.269032 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:10.269033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:10.269034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:10.269144 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:10.269289 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:10.269497 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 06:47:10.269563 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:47:10.270922 11683 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:10.271574 11683 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:10.276516 11683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a2c550f4752494fb37b90bc7692f9b1: Generated new TSK 0
I20260807 06:47:10.276700 11683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:10.282173 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11567
W20260807 06:47:10.297034 11547 connection.cc:535] client connection to 127.0.0.1:39593 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39593): Connection reset by peer (error 104)
2026-08-07T06:47:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1521 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:10 dist-test-slave-8hhm krb5kdc[11707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:10 dist-test-slave-8hhm krb5kdc[11707](info): set up 2 sockets
Aug 07 06:47:10 dist-test-slave-8hhm krb5kdc[11707](info): commencing operation
krb5kdc: starting...
W20260807 06:47:11.534380 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:11 dist-test-slave-8hhm krb5kdc[11707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:11.654006 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45041
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:11.736192 11729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:11.736399 11729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:11.736421 11729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:11.737578 11729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:11.737619 11729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:11.737633 11729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:11.737645 11729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:11.737703 11729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:11.739176 11729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45041
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:11.739383 11729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:11.739611 11729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:11.744522 11736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:11.744565 11735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:11.744522 11741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:11.744740 11729 server_base.cc:1034] running on GCE node
I20260807 06:47:11.745003 11729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:11.745345 11729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:11.746487 11729 hybrid_clock.cc:648] HybridClock initialized: now 1786085231746462 us; error 42 us; skew 500 ppm
Aug 07 06:47:11 dist-test-slave-8hhm krb5kdc[11707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085231, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:11.748965 11729 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:11.749469 11729 webserver.cc:460] Webserver started at http://127.0.0.1:40279/ using document root <none> and password file <none>
I20260807 06:47:11.749691 11729 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:11.749735 11729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:11.749902 11729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:11.750912 11729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "594ea2166aca450e95817133b85707cc"
format_stamp: "Formatted at 2026-08-07 06:47:11 on dist-test-slave-8hhm"
server_key: "79062056c9953f50257d909d6226f9de"
server_key_iv: "bef4bce344c9e50344608553ed6ea764"
server_key_version: "encryptionkey@0"
I20260807 06:47:11.751303 11729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "594ea2166aca450e95817133b85707cc"
format_stamp: "Formatted at 2026-08-07 06:47:11 on dist-test-slave-8hhm"
server_key: "79062056c9953f50257d909d6226f9de"
server_key_iv: "bef4bce344c9e50344608553ed6ea764"
server_key_version: "encryptionkey@0"
I20260807 06:47:11.752629 11729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:47:11.753372 11750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:11.753554 11729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:11.753684 11729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "594ea2166aca450e95817133b85707cc"
format_stamp: "Formatted at 2026-08-07 06:47:11 on dist-test-slave-8hhm"
server_key: "79062056c9953f50257d909d6226f9de"
server_key_iv: "bef4bce344c9e50344608553ed6ea764"
server_key_version: "encryptionkey@0"
I20260807 06:47:11.753758 11729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:11.765775 11729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:11.767534 11729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:11.767696 11729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:11.771898 11729 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45041
I20260807 06:47:11.771981 11826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45041 every 8 connection(s)
I20260807 06:47:11.772261 11729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:11.773108 11827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:11.775370 11827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc: Bootstrap starting.
I20260807 06:47:11.775943 11827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:11.776238 11827 log.cc:824] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:11.776957 11827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc: No bootstrap required, opened a new log
I20260807 06:47:11.778673 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11729
I20260807 06:47:11.778592 11827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594ea2166aca450e95817133b85707cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45041 } }
I20260807 06:47:11.778755 11827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:11.778795 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:11.778793 11827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 594ea2166aca450e95817133b85707cc, State: Initialized, Role: FOLLOWER
I20260807 06:47:11.778945 11827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594ea2166aca450e95817133b85707cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45041 } }
I20260807 06:47:11.779023 11827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:11.779026 11814 external_mini_cluster.cc:1428] Setting key 532c0a7ce3bf157a0f57bab7480cd3f4
I20260807 06:47:11.779058 11827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:11.779099 11827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:11.780229 11827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594ea2166aca450e95817133b85707cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45041 } }
I20260807 06:47:11.780340 11827 leader_election.cc:302] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 594ea2166aca450e95817133b85707cc; no voters:
I20260807 06:47:11.780544 11827 leader_election.cc:288] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:11.780596 11835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:11.780750 11835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [term 1 LEADER]: Becoming Leader. State: Replica: 594ea2166aca450e95817133b85707cc, State: Running, Role: LEADER
I20260807 06:47:11.780789 11827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:11.780838 11835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594ea2166aca450e95817133b85707cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45041 } }
I20260807 06:47:11.781168 11836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "594ea2166aca450e95817133b85707cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594ea2166aca450e95817133b85707cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45041 } } }
I20260807 06:47:11.781272 11836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:11.781533 11837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 594ea2166aca450e95817133b85707cc. Latest consensus state: current_term: 1 leader_uuid: "594ea2166aca450e95817133b85707cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594ea2166aca450e95817133b85707cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45041 } } }
I20260807 06:47:11.781628 11837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:11.781745 11844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:11.782274 11844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:11.784250 11844 catalog_manager.cc:1347] Generated new cluster ID: 633360a0c86641e7bba51e569571ae82
I20260807 06:47:11.784307 11844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:11.785166 11833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:11.779487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48495 (local address 127.0.0.1:45041)
0807 06:47:11.779771 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:11.779782 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:11.779825 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:47:11.779956 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:11.779963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:11.780026 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:11.780205 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:11.780444 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:11.781969 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:11.783080 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:11.783581 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:11.783700 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:11.784453 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:11.784457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:11.784457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:11.784662 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:11.784701 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:11.784715 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:11.784809 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:11.784921 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 06:47:11.784949 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":159,"threads_started":1}
I20260807 06:47:11.786103 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:11.791401 11833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:11.787629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43805 (local address 127.0.0.1:45041)
0807 06:47:11.787667 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:11.787668 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:11.787778 (+ 110us) server_negotiation.cc:407] Connection header received
0807 06:47:11.787872 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:11.787873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:11.787883 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:11.787911 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:11.788110 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:11.788873 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:11.790005 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:11.790333 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:11.790375 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:11.791131 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:11.791133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:11.791133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:11.791137 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:11.791150 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:11.791154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:11.791187 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:11.791318 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 06:47:11.791331 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:47:11.801486 11844 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:11.802175 11844 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:11.821264 11844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 594ea2166aca450e95817133b85707cc: Generated new TSK 0
I20260807 06:47:11.821473 11844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:11.824117 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11729
W20260807 06:47:11.838613 11705 connection.cc:535] client connection to 127.0.0.1:45041 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45041): Connection reset by peer (error 104)
2026-08-07T06:47:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1541 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:11 dist-test-slave-8hhm krb5kdc[11871](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:11 dist-test-slave-8hhm krb5kdc[11871](info): set up 2 sockets
Aug 07 06:47:11 dist-test-slave-8hhm krb5kdc[11871](info): commencing operation
krb5kdc: starting...
W20260807 06:47:13.072715 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:13 dist-test-slave-8hhm krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:13.191357 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34271
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:13.272440 11886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:13.272642 11886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:13.272666 11886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:13.273728 11886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:13.273762 11886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:13.273775 11886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:13.273787 11886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:13.273799 11886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:13.275173 11886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34271
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:13.275409 11886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:13.275599 11886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:13.280457 11898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:13.280591 11896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:13.280646 11886 server_base.cc:1034] running on GCE node
W20260807 06:47:13.280524 11900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:13.281001 11886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:13.281332 11886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:13.282496 11886 hybrid_clock.cc:648] HybridClock initialized: now 1786085233282480 us; error 30 us; skew 500 ppm
Aug 07 06:47:13 dist-test-slave-8hhm krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085233, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:13.289924 11886 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:13.290385 11886 webserver.cc:460] Webserver started at http://127.0.0.1:36441/ using document root <none> and password file <none>
I20260807 06:47:13.290611 11886 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:13.290657 11886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:13.290829 11886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:13.291893 11886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "80e6151354f14e66b7e38f8c7b5c668d"
format_stamp: "Formatted at 2026-08-07 06:47:13 on dist-test-slave-8hhm"
server_key: "94a0ca2c4dc262eaf1e52c369474f0a2"
server_key_iv: "066c28a49e201771d5a82222d3610a5b"
server_key_version: "encryptionkey@0"
I20260807 06:47:13.292274 11886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "80e6151354f14e66b7e38f8c7b5c668d"
format_stamp: "Formatted at 2026-08-07 06:47:13 on dist-test-slave-8hhm"
server_key: "94a0ca2c4dc262eaf1e52c369474f0a2"
server_key_iv: "066c28a49e201771d5a82222d3610a5b"
server_key_version: "encryptionkey@0"
I20260807 06:47:13.293677 11886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:13.294430 11916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:13.294603 11886 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:13.294701 11886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "80e6151354f14e66b7e38f8c7b5c668d"
format_stamp: "Formatted at 2026-08-07 06:47:13 on dist-test-slave-8hhm"
server_key: "94a0ca2c4dc262eaf1e52c369474f0a2"
server_key_iv: "066c28a49e201771d5a82222d3610a5b"
server_key_version: "encryptionkey@0"
I20260807 06:47:13.294759 11886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:13.298079 11886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:13.300297 11886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:13.300400 11886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:13.304329 11886 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34271
I20260807 06:47:13.304409 11991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34271 every 8 connection(s)
I20260807 06:47:13.304714 11886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:13.305810 11992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:13.305886 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 11886
I20260807 06:47:13.306044 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:13.306247 11814 external_mini_cluster.cc:1428] Setting key be8ae00667e848c0dbcf061cbe5eda88
I20260807 06:47:13.308743 11995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:13.306766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54135 (local address 127.0.0.1:34271)
0807 06:47:13.306983 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:13.306991 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:13.307093 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:47:13.307540 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:13.307546 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:13.307570 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:13.307684 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:13.308283 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:13.308286 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:13.308286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:13.308290 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:13.308326 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:13.308336 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:13.308392 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:13.308487 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 06:47:13.308550 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260807 06:47:13.309413 11992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d: Bootstrap starting.
I20260807 06:47:13.309716 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:13.310179 11992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:13.310505 11992 log.cc:824] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:13.311204 11992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d: No bootstrap required, opened a new log
I20260807 06:47:13.312523 11995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:13.311484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53361 (local address 127.0.0.1:34271)
0807 06:47:13.311556 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:13.311558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:13.311642 (+ 84us) server_negotiation.cc:407] Connection header received
0807 06:47:13.311689 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:13.311690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:13.311694 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:13.311774 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:13.312324 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:13.312325 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:13.312325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:13.312329 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:13.312342 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:13.312347 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:13.312416 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:13.312450 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 06:47:13.312462 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:47:13.313589 11992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6151354f14e66b7e38f8c7b5c668d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260807 06:47:13.313726 11992 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:13.313750 11992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80e6151354f14e66b7e38f8c7b5c668d, State: Initialized, Role: FOLLOWER
I20260807 06:47:13.313859 11992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6151354f14e66b7e38f8c7b5c668d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260807 06:47:13.313958 11992 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:13.313982 11992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:13.314010 11992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:13.314496 11992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6151354f14e66b7e38f8c7b5c668d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260807 06:47:13.314580 11992 leader_election.cc:302] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80e6151354f14e66b7e38f8c7b5c668d; no voters:
I20260807 06:47:13.314710 11992 leader_election.cc:288] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:13.314771 12003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:13.314958 12003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [term 1 LEADER]: Becoming Leader. State: Replica: 80e6151354f14e66b7e38f8c7b5c668d, State: Running, Role: LEADER
I20260807 06:47:13.314965 11992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:13.315106 12003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6151354f14e66b7e38f8c7b5c668d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260807 06:47:13.315477 12003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80e6151354f14e66b7e38f8c7b5c668d. Latest consensus state: current_term: 1 leader_uuid: "80e6151354f14e66b7e38f8c7b5c668d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6151354f14e66b7e38f8c7b5c668d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } } }
I20260807 06:47:13.315517 12005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80e6151354f14e66b7e38f8c7b5c668d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6151354f14e66b7e38f8c7b5c668d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } } }
I20260807 06:47:13.315608 12003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:13.315861 12005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:13.315872 12016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:13.316483 12016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:13.318035 12016 catalog_manager.cc:1347] Generated new cluster ID: ca6267aab5864f958815dbc8a1f9319e
I20260807 06:47:13.318089 12016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:13.335553 12016 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:13.335737 12016 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:13.341725 12016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80e6151354f14e66b7e38f8c7b5c668d: Generated new TSK 0
I20260807 06:47:13.341933 12016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:13.350252 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 11886
2026-08-07T06:47:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1519 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:13 dist-test-slave-8hhm krb5kdc[12036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:13 dist-test-slave-8hhm krb5kdc[12036](info): set up 2 sockets
Aug 07 06:47:13 dist-test-slave-8hhm krb5kdc[12036](info): commencing operation
krb5kdc: starting...
W20260807 06:47:14.592628 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:14 dist-test-slave-8hhm krb5kdc[12036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085234, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:14.719657 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44041
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:14.803536 12056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:14.803737 12056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:14.803759 12056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:14.804811 12056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:14.804845 12056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:14.804858 12056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:14.804872 12056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:14.804883 12056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:14.806289 12056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:14.806546 12056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:14.806814 12056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:14.812106 12062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:14.812114 12064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:14.812307 12066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:14.812273 12056 server_base.cc:1034] running on GCE node
I20260807 06:47:14.812716 12056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:14.813027 12056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:14.814205 12056 hybrid_clock.cc:648] HybridClock initialized: now 1786085234814175 us; error 57 us; skew 500 ppm
Aug 07 06:47:14 dist-test-slave-8hhm krb5kdc[12036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085234, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:14.817610 12056 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:14.818078 12056 webserver.cc:460] Webserver started at http://127.0.0.1:45687/ using document root <none> and password file <none>
I20260807 06:47:14.818288 12056 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:14.818329 12056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:14.818419 12056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:14.819442 12056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "b2571c6622c242b89374e996b3269e15"
format_stamp: "Formatted at 2026-08-07 06:47:14 on dist-test-slave-8hhm"
server_key: "d006212fa40d33cee921acce035a5ae3"
server_key_iv: "5af5c7c371666446109e7ec9fb964fca"
server_key_version: "encryptionkey@0"
I20260807 06:47:14.819769 12056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "b2571c6622c242b89374e996b3269e15"
format_stamp: "Formatted at 2026-08-07 06:47:14 on dist-test-slave-8hhm"
server_key: "d006212fa40d33cee921acce035a5ae3"
server_key_iv: "5af5c7c371666446109e7ec9fb964fca"
server_key_version: "encryptionkey@0"
I20260807 06:47:14.821041 12056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:14.821799 12075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:14.821959 12056 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:14.822057 12056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "b2571c6622c242b89374e996b3269e15"
format_stamp: "Formatted at 2026-08-07 06:47:14 on dist-test-slave-8hhm"
server_key: "d006212fa40d33cee921acce035a5ae3"
server_key_iv: "5af5c7c371666446109e7ec9fb964fca"
server_key_version: "encryptionkey@0"
I20260807 06:47:14.822116 12056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:14.843984 12056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:14.846122 12056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:14.846249 12056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:14.850304 12056 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44041
I20260807 06:47:14.850391 12152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44041 every 8 connection(s)
I20260807 06:47:14.850756 12056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:14.851686 12154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:14.854061 12154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15: Bootstrap starting.
I20260807 06:47:14.854662 12154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:14.854943 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12056
I20260807 06:47:14.854970 12154 log.cc:824] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:14.855059 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:14.855259 11814 external_mini_cluster.cc:1428] Setting key fa2c0b058e2719e4c30b86e4297070c9
I20260807 06:47:14.855938 12154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15: No bootstrap required, opened a new log
I20260807 06:47:14.858603 12154 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2571c6622c242b89374e996b3269e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260807 06:47:14.858800 12154 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:14.858839 12154 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2571c6622c242b89374e996b3269e15, State: Initialized, Role: FOLLOWER
I20260807 06:47:14.858978 12154 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2571c6622c242b89374e996b3269e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260807 06:47:14.859057 12154 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:14.859086 12154 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:14.859148 12154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:14.859860 12154 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2571c6622c242b89374e996b3269e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260807 06:47:14.859951 12154 leader_election.cc:302] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2571c6622c242b89374e996b3269e15; no voters:
I20260807 06:47:14.860139 12154 leader_election.cc:288] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:14.860191 12163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:14.860363 12163 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [term 1 LEADER]: Becoming Leader. State: Replica: b2571c6622c242b89374e996b3269e15, State: Running, Role: LEADER
I20260807 06:47:14.860440 12154 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:14.860567 12163 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2571c6622c242b89374e996b3269e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260807 06:47:14.860961 12163 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2571c6622c242b89374e996b3269e15. Latest consensus state: current_term: 1 leader_uuid: "b2571c6622c242b89374e996b3269e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2571c6622c242b89374e996b3269e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } } }
I20260807 06:47:14.861254 12163 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:14.861148 12165 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2571c6622c242b89374e996b3269e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2571c6622c242b89374e996b3269e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } } }
I20260807 06:47:14.861714 12165 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:14.861939 12175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:14.862553 12175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 06:47:14 dist-test-slave-8hhm krb5kdc[12036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085234, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:47:14.865512 12175 catalog_manager.cc:1347] Generated new cluster ID: 473d3d498e914cb1b13a7b0114765357
I20260807 06:47:14.865628 12175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:14.866856 12160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:14.855812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56363 (local address 127.0.0.1:44041)
0807 06:47:14.855998 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:14.856007 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:14.856041 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:47:14.856488 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:14.856495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:14.856541 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:14.856651 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:14.857580 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:14.858485 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:14.859572 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:14.860189 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:14.860315 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:14.863386 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:14.863390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:14.863391 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:14.863404 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:14.865142 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:14.865617 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:14.865620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:14.865620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:14.865787 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:14.866011 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:14.866012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:14.866013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:14.866253 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:14.866449 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:14.866526 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:47:14.866664 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260807 06:47:14.867862 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:14.875319 12175 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:14.875653 12160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:14.869325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37165 (local address 127.0.0.1:44041)
0807 06:47:14.869367 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:14.869369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:14.869404 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:47:14.869474 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:14.869475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:14.869484 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:14.869536 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:14.870050 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:14.870542 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:14.871319 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:14.871558 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:14.871632 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:14.872852 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:14.872854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:14.872854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:14.872862 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:14.874254 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:14.874614 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:14.874616 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:14.874616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:14.874671 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:14.874892 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:14.874893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:14.874893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:14.875145 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:14.875245 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:14.875482 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 06:47:14.875562 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:47:14.876140 12175 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:14.885453 12175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2571c6622c242b89374e996b3269e15: Generated new TSK 0
I20260807 06:47:14.885669 12175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:14.892727 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12056
2026-08-07T06:47:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:14 dist-test-slave-8hhm krb5kdc[12199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:14 dist-test-slave-8hhm krb5kdc[12199](info): set up 2 sockets
Aug 07 06:47:14 dist-test-slave-8hhm krb5kdc[12199](info): commencing operation
krb5kdc: starting...
W20260807 06:47:16.138509 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:16 dist-test-slave-8hhm krb5kdc[12199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:16.262066 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:16.346009 12216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:16.346267 12216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:16.346305 12216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:16.347512 12216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:16.347584 12216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:16.347607 12216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:16.347630 12216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:16.347657 12216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:16.349181 12216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:16.349496 12216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:16.349742 12216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:16.354898 12228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:16.354912 12226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:16.354898 12225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:16.355082 12216 server_base.cc:1034] running on GCE node
I20260807 06:47:16.355408 12216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:16.355727 12216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:16.356984 12216 hybrid_clock.cc:648] HybridClock initialized: now 1786085236356930 us; error 35 us; skew 500 ppm
Aug 07 06:47:16 dist-test-slave-8hhm krb5kdc[12199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085236, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:16.359676 12216 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:16.360214 12216 webserver.cc:460] Webserver started at http://127.0.0.1:34655/ using document root <none> and password file <none>
I20260807 06:47:16.360471 12216 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:16.360546 12216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:16.360774 12216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:16.361990 12216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "7ad1ff76d40e41d78467529829c250b1"
format_stamp: "Formatted at 2026-08-07 06:47:16 on dist-test-slave-8hhm"
server_key: "5381e6277f43cdfc69035f46a5e5934e"
server_key_iv: "506fe08ced543420aaec64fcb26b4d88"
server_key_version: "encryptionkey@0"
I20260807 06:47:16.362407 12216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "7ad1ff76d40e41d78467529829c250b1"
format_stamp: "Formatted at 2026-08-07 06:47:16 on dist-test-slave-8hhm"
server_key: "5381e6277f43cdfc69035f46a5e5934e"
server_key_iv: "506fe08ced543420aaec64fcb26b4d88"
server_key_version: "encryptionkey@0"
I20260807 06:47:16.363875 12216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:47:16.364689 12237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:16.364867 12216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:16.364979 12216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "7ad1ff76d40e41d78467529829c250b1"
format_stamp: "Formatted at 2026-08-07 06:47:16 on dist-test-slave-8hhm"
server_key: "5381e6277f43cdfc69035f46a5e5934e"
server_key_iv: "506fe08ced543420aaec64fcb26b4d88"
server_key_version: "encryptionkey@0"
I20260807 06:47:16.365089 12216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:16.396606 12216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:16.398653 12216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:16.398825 12216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:16.403092 12216 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44353
I20260807 06:47:16.403131 12310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44353 every 8 connection(s)
I20260807 06:47:16.403520 12216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:16.404382 12311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:16.406761 12311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1: Bootstrap starting.
I20260807 06:47:16.407292 12311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:16.407526 12311 log.cc:824] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:16.407584 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12216
I20260807 06:47:16.407699 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:16.407922 11814 external_mini_cluster.cc:1428] Setting key 79abcc0d5569e7d64329756c8fcfb964
I20260807 06:47:16.408383 12311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1: No bootstrap required, opened a new log
I20260807 06:47:16.411093 12311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1ff76d40e41d78467529829c250b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260807 06:47:16.411304 12311 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:16.411342 12311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad1ff76d40e41d78467529829c250b1, State: Initialized, Role: FOLLOWER
I20260807 06:47:16.411476 12311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1ff76d40e41d78467529829c250b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260807 06:47:16.411558 12311 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:16.411588 12311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:16.411633 12311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:16.412339 12311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1ff76d40e41d78467529829c250b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260807 06:47:16.412432 12311 leader_election.cc:302] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ad1ff76d40e41d78467529829c250b1; no voters:
I20260807 06:47:16.412662 12311 leader_election.cc:288] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:16.412688 12317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:16.412810 12317 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [term 1 LEADER]: Becoming Leader. State: Replica: 7ad1ff76d40e41d78467529829c250b1, State: Running, Role: LEADER
I20260807 06:47:16.412916 12317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1ff76d40e41d78467529829c250b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260807 06:47:16.412945 12311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:16.413646 12318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ad1ff76d40e41d78467529829c250b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1ff76d40e41d78467529829c250b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } } }
I20260807 06:47:16.413795 12318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:16.413933 12319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ad1ff76d40e41d78467529829c250b1. Latest consensus state: current_term: 1 leader_uuid: "7ad1ff76d40e41d78467529829c250b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1ff76d40e41d78467529829c250b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } } }
I20260807 06:47:16.414078 12319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:16.414338 12327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:16.414667 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:16.408457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35223 (local address 127.0.0.1:44353)
0807 06:47:16.408650 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:16.408659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:16.408705 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:47:16.409738 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:16.409745 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:16.409792 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:16.409903 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:16.410161 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:16.411065 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:16.412190 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:16.412687 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:16.413129 (+ 442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:16.413582 (+ 453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:16.413586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:16.413586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:16.413787 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:16.413825 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:16.413840 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:16.414344 (+ 504us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:16.414380 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 06:47:16.414447 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260807 06:47:16.414898 12327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:16.415654 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:16.416523 12327 catalog_manager.cc:1347] Generated new cluster ID: 2717e91ed6d645a688a247d775e7bc4c
I20260807 06:47:16.416577 12327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:16.420712 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:16.417467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52793 (local address 127.0.0.1:44353)
0807 06:47:16.417504 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:16.417506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:16.417596 (+ 90us) server_negotiation.cc:407] Connection header received
0807 06:47:16.417637 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:16.417638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:16.417649 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:16.417702 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:16.417824 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:16.418495 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:16.419478 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:16.419766 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:16.419826 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:16.420475 (+ 649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:16.420477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:16.420477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:16.420481 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:16.420495 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:16.420499 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:16.420547 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:16.420617 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 06:47:16.420636 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:47:16.429879 12327 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:16.430497 12327 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:16.433387 12327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ad1ff76d40e41d78467529829c250b1: Generated new TSK 0
I20260807 06:47:16.433568 12327 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:16.436583 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12216
2026-08-07T06:47:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:16 dist-test-slave-8hhm krb5kdc[12349](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:16 dist-test-slave-8hhm krb5kdc[12349](info): set up 2 sockets
Aug 07 06:47:16 dist-test-slave-8hhm krb5kdc[12349](info): commencing operation
krb5kdc: starting...
W20260807 06:47:17.687355 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:17 dist-test-slave-8hhm krb5kdc[12349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:17.810092 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43381
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:17.896417 12367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:17.896631 12367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:17.896654 12367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:17.897847 12367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:17.897897 12367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:17.897912 12367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:17.897927 12367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:17.897941 12367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:17.899500 12367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:17.899770 12367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:17.900029 12367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:17.905153 12378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:17.905165 12373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:17.905277 12374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:17.905398 12367 server_base.cc:1034] running on GCE node
I20260807 06:47:17.905756 12367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:17.906072 12367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:17.907240 12367 hybrid_clock.cc:648] HybridClock initialized: now 1786085237907219 us; error 41 us; skew 500 ppm
Aug 07 06:47:17 dist-test-slave-8hhm krb5kdc[12349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085237, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:17.909842 12367 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:17.910238 12367 webserver.cc:460] Webserver started at http://127.0.0.1:32887/ using document root <none> and password file <none>
I20260807 06:47:17.910457 12367 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:17.910501 12367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:17.910590 12367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:17.911600 12367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "bdb065747d3c4738bbf039c7fbebf4b8"
format_stamp: "Formatted at 2026-08-07 06:47:17 on dist-test-slave-8hhm"
server_key: "f2d9c9a81796461759f31e929458d6fb"
server_key_iv: "7bd57ac8179d2dabecfd47797ae17c20"
server_key_version: "encryptionkey@0"
I20260807 06:47:17.911929 12367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "bdb065747d3c4738bbf039c7fbebf4b8"
format_stamp: "Formatted at 2026-08-07 06:47:17 on dist-test-slave-8hhm"
server_key: "f2d9c9a81796461759f31e929458d6fb"
server_key_iv: "7bd57ac8179d2dabecfd47797ae17c20"
server_key_version: "encryptionkey@0"
I20260807 06:47:17.913200 12367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:47:17.913946 12388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:17.914120 12367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:17.914230 12367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "bdb065747d3c4738bbf039c7fbebf4b8"
format_stamp: "Formatted at 2026-08-07 06:47:17 on dist-test-slave-8hhm"
server_key: "f2d9c9a81796461759f31e929458d6fb"
server_key_iv: "7bd57ac8179d2dabecfd47797ae17c20"
server_key_version: "encryptionkey@0"
I20260807 06:47:17.914307 12367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:17.917656 12367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:17.919456 12367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:17.919613 12367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:17.923595 12367 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43381
I20260807 06:47:17.923647 12463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43381 every 8 connection(s)
I20260807 06:47:17.923983 12367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:17.924999 12464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:17.925369 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12367
I20260807 06:47:17.925494 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:17.925684 11814 external_mini_cluster.cc:1428] Setting key d8f3e3823dbc6c3d73d934b8be72fcd1
I20260807 06:47:17.928264 12464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8: Bootstrap starting.
I20260807 06:47:17.928334 12470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:17.926212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56211 (local address 127.0.0.1:43381)
0807 06:47:17.926476 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:17.926485 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:17.926515 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:47:17.927062 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:17.927072 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:17.927105 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:17.927264 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:17.927906 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:17.927910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:17.927911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:17.927915 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:17.927957 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:17.927972 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:17.928050 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:17.928106 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 06:47:17.928145 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":73,"threads_started":1}
I20260807 06:47:17.929010 12464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:17.929288 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:17.929387 12464 log.cc:824] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:17.930078 12464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8: No bootstrap required, opened a new log
I20260807 06:47:17.931669 12470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:17.930757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47813 (local address 127.0.0.1:43381)
0807 06:47:17.930796 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:17.930797 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:17.930855 (+ 58us) server_negotiation.cc:407] Connection header received
0807 06:47:17.930924 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:17.930924 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:17.930928 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:17.930968 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:17.931461 (+ 493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:17.931462 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:17.931462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:17.931465 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:17.931476 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:17.931479 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:17.931517 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:17.931575 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 06:47:17.931584 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 06:47:17.932525 12464 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43381 } }
I20260807 06:47:17.932657 12464 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:17.932685 12464 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb065747d3c4738bbf039c7fbebf4b8, State: Initialized, Role: FOLLOWER
I20260807 06:47:17.932827 12464 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43381 } }
I20260807 06:47:17.932917 12464 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:17.932973 12464 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:17.933022 12464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:17.933604 12464 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43381 } }
I20260807 06:47:17.933728 12464 leader_election.cc:302] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdb065747d3c4738bbf039c7fbebf4b8; no voters:
I20260807 06:47:17.933887 12464 leader_election.cc:288] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:17.933938 12482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:17.934098 12482 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [term 1 LEADER]: Becoming Leader. State: Replica: bdb065747d3c4738bbf039c7fbebf4b8, State: Running, Role: LEADER
I20260807 06:47:17.934116 12464 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:17.934196 12482 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43381 } }
I20260807 06:47:17.934525 12482 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdb065747d3c4738bbf039c7fbebf4b8. Latest consensus state: current_term: 1 leader_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43381 } } }
I20260807 06:47:17.934641 12482 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:17.934538 12486 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb065747d3c4738bbf039c7fbebf4b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43381 } } }
I20260807 06:47:17.934751 12486 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:17.935027 12495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:17.935786 12495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:17.937336 12495 catalog_manager.cc:1347] Generated new cluster ID: 2c3053214fca44b0a75ce683b8787e18
I20260807 06:47:17.937388 12495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:17.952256 12495 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:17.952417 12495 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:17.956738 12495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdb065747d3c4738bbf039c7fbebf4b8: Generated new TSK 0
I20260807 06:47:17.956904 12495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:17.962841 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12367
2026-08-07T06:47:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1525 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:18 dist-test-slave-8hhm krb5kdc[12510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:18 dist-test-slave-8hhm krb5kdc[12510](info): set up 2 sockets
Aug 07 06:47:18 dist-test-slave-8hhm krb5kdc[12510](info): commencing operation
krb5kdc: starting...
W20260807 06:47:19.221935 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:19 dist-test-slave-8hhm krb5kdc[12510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:19.345283 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41045
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:19.428175 12530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:19.428378 12530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:19.428404 12530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:19.429476 12530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:19.429510 12530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:19.429524 12530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:19.429536 12530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:19.429548 12530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:19.430980 12530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:19.431167 12530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:19.431368 12530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:19.436255 12540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:19.436266 12538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:19.436321 12537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:19.436486 12530 server_base.cc:1034] running on GCE node
I20260807 06:47:19.436734 12530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:19.437016 12530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:19.438184 12530 hybrid_clock.cc:648] HybridClock initialized: now 1786085239438157 us; error 53 us; skew 500 ppm
Aug 07 06:47:19 dist-test-slave-8hhm krb5kdc[12510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085239, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:19.446395 12530 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:19.446906 12530 webserver.cc:460] Webserver started at http://127.0.0.1:35991/ using document root <none> and password file <none>
I20260807 06:47:19.447163 12530 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:19.447229 12530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:19.447376 12530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:19.448459 12530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "7042e83712c4468ba3f504b7fa71ddee"
format_stamp: "Formatted at 2026-08-07 06:47:19 on dist-test-slave-8hhm"
server_key: "fb4d8bf04701b3f6b1e9c88ae4910113"
server_key_iv: "9318154e40a61e6cb43a492647ceb46d"
server_key_version: "encryptionkey@0"
I20260807 06:47:19.448828 12530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "7042e83712c4468ba3f504b7fa71ddee"
format_stamp: "Formatted at 2026-08-07 06:47:19 on dist-test-slave-8hhm"
server_key: "fb4d8bf04701b3f6b1e9c88ae4910113"
server_key_iv: "9318154e40a61e6cb43a492647ceb46d"
server_key_version: "encryptionkey@0"
I20260807 06:47:19.450251 12530 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:19.451004 12547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:19.451182 12530 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:19.451305 12530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "7042e83712c4468ba3f504b7fa71ddee"
format_stamp: "Formatted at 2026-08-07 06:47:19 on dist-test-slave-8hhm"
server_key: "fb4d8bf04701b3f6b1e9c88ae4910113"
server_key_iv: "9318154e40a61e6cb43a492647ceb46d"
server_key_version: "encryptionkey@0"
I20260807 06:47:19.451387 12530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:19.472254 12530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:19.474514 12530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:19.474680 12530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:19.479018 12530 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41045
I20260807 06:47:19.479063 12620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41045 every 8 connection(s)
I20260807 06:47:19.479446 12530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:19.480345 12621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:19.480767 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12530
I20260807 06:47:19.480898 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:19.481101 11814 external_mini_cluster.cc:1428] Setting key d167a1da6d2b99dc9bc3e2a0cebb2b39
I20260807 06:47:19.483613 12621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee: Bootstrap starting.
I20260807 06:47:19.484246 12621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:19.484566 12621 log.cc:824] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:19.485359 12621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee: No bootstrap required, opened a new log
Aug 07 06:47:19 dist-test-slave-8hhm krb5kdc[12510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:47:19.487936 12621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7042e83712c4468ba3f504b7fa71ddee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41045 } }
I20260807 06:47:19.488098 12621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:19.488123 12621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7042e83712c4468ba3f504b7fa71ddee, State: Initialized, Role: FOLLOWER
I20260807 06:47:19.488263 12621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7042e83712c4468ba3f504b7fa71ddee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41045 } }
I20260807 06:47:19.488339 12621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:19.488389 12621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:19.488431 12621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:19.488978 12621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7042e83712c4468ba3f504b7fa71ddee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41045 } }
I20260807 06:47:19.489073 12621 leader_election.cc:302] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7042e83712c4468ba3f504b7fa71ddee; no voters:
I20260807 06:47:19.489279 12621 leader_election.cc:288] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:19.489311 12627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:19.489462 12627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [term 1 LEADER]: Becoming Leader. State: Replica: 7042e83712c4468ba3f504b7fa71ddee, State: Running, Role: LEADER
I20260807 06:47:19.489547 12621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:19.489604 12627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7042e83712c4468ba3f504b7fa71ddee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41045 } }
I20260807 06:47:19.489915 12627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7042e83712c4468ba3f504b7fa71ddee. Latest consensus state: current_term: 1 leader_uuid: "7042e83712c4468ba3f504b7fa71ddee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7042e83712c4468ba3f504b7fa71ddee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41045 } } }
I20260807 06:47:19.489928 12630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7042e83712c4468ba3f504b7fa71ddee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7042e83712c4468ba3f504b7fa71ddee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41045 } } }
I20260807 06:47:19.490097 12630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:19.490309 12627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:19.491024 12647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:19.492199 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:19.481665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:57621 (local address 127.0.0.1:41045)
0807 06:47:19.481836 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:19.481843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:19.481867 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:47:19.482321 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:19.482329 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:19.482407 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:19.482529 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:19.483314 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:19.484238 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:19.485203 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:19.485669 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:19.485759 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:19.488389 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:19.488393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:19.488393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:19.488406 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:19.490435 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:19.490883 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:19.490886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:19.490887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:19.491000 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:19.491275 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:19.491276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:19.491277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:19.491534 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:19.491720 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:19.491888 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 06:47:19.491999 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260807 06:47:19.491519 12647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:19.493316 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:19.493963 12647 catalog_manager.cc:1347] Generated new cluster ID: 7035d52f0e4346188273f85c813c6ef1
I20260807 06:47:19.494005 12647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:19.504542 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:19.494876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:57631 (local address 127.0.0.1:41045)
0807 06:47:19.494913 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:19.494915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:19.497423 (+ 2508us) server_negotiation.cc:407] Connection header received
0807 06:47:19.497483 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:19.497484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:19.497496 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:19.497543 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:19.498227 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:19.498946 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:19.499973 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:19.500304 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:19.500364 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:19.501798 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:19.501800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:19.501800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:19.501806 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:19.503353 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:19.503772 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:19.503772 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:19.503773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:19.503827 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:19.504055 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:19.504056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:19.504056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:19.504166 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:19.504266 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:19.504401 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 06:47:19.504458 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:47:19.522017 12647 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:19.522781 12647 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:19.537200 12647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7042e83712c4468ba3f504b7fa71ddee: Generated new TSK 0
I20260807 06:47:19.537495 12647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:19.544737 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12530
W20260807 06:47:19.559413 12507 connection.cc:535] client connection to 127.0.0.1:41045 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41045): Connection reset by peer (error 104)
2026-08-07T06:47:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:19 dist-test-slave-8hhm krb5kdc[12670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:19 dist-test-slave-8hhm krb5kdc[12670](info): set up 2 sockets
Aug 07 06:47:19 dist-test-slave-8hhm krb5kdc[12670](info): commencing operation
krb5kdc: starting...
W20260807 06:47:20.782115 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:20 dist-test-slave-8hhm krb5kdc[12670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:20.907752 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40531
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:20.991397 12686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:20.991600 12686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:20.991622 12686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:20.992722 12686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:20.992758 12686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:20.992772 12686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:20.992784 12686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:20.992796 12686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:20.994302 12686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:20.994486 12686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:20.994653 12686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:20.999559 12694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:20.999563 12693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:20.999603 12697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:20.999742 12686 server_base.cc:1034] running on GCE node
I20260807 06:47:21.000020 12686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:21.000351 12686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:21.001506 12686 hybrid_clock.cc:648] HybridClock initialized: now 1786085241001501 us; error 36 us; skew 500 ppm
Aug 07 06:47:21 dist-test-slave-8hhm krb5kdc[12670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085241, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:21.004040 12686 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:21.004516 12686 webserver.cc:460] Webserver started at http://127.0.0.1:36999/ using document root <none> and password file <none>
I20260807 06:47:21.004761 12686 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:21.004828 12686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:21.004976 12686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:21.006086 12686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421"
format_stamp: "Formatted at 2026-08-07 06:47:21 on dist-test-slave-8hhm"
server_key: "6eb8c0afae80884265d429497ba50d0e"
server_key_iv: "a28108b9209874da4c49f54de9a00885"
server_key_version: "encryptionkey@0"
I20260807 06:47:21.006531 12686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421"
format_stamp: "Formatted at 2026-08-07 06:47:21 on dist-test-slave-8hhm"
server_key: "6eb8c0afae80884265d429497ba50d0e"
server_key_iv: "a28108b9209874da4c49f54de9a00885"
server_key_version: "encryptionkey@0"
I20260807 06:47:21.007871 12686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:21.008611 12707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:21.008783 12686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:21.008891 12686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421"
format_stamp: "Formatted at 2026-08-07 06:47:21 on dist-test-slave-8hhm"
server_key: "6eb8c0afae80884265d429497ba50d0e"
server_key_iv: "a28108b9209874da4c49f54de9a00885"
server_key_version: "encryptionkey@0"
I20260807 06:47:21.008965 12686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:21.023295 12686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:21.025635 12686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:21.025792 12686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:21.029927 12686 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40531
I20260807 06:47:21.029963 12786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40531 every 8 connection(s)
I20260807 06:47:21.030328 12686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:21.031208 12788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:21.032967 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12686
I20260807 06:47:21.033093 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:21.033317 11814 external_mini_cluster.cc:1428] Setting key 4492ea8584aaa2684ffe0363518f2724
I20260807 06:47:21.033937 12788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421: Bootstrap starting.
I20260807 06:47:21.034673 12788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:21.035022 12788 log.cc:824] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:21.035806 12788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421: No bootstrap required, opened a new log
I20260807 06:47:21.038187 12788 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40531 } }
I20260807 06:47:21.038369 12788 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:21.038408 12788 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ba7bd42c244f3dbcc9f56fc9aed421, State: Initialized, Role: FOLLOWER
I20260807 06:47:21.038580 12788 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40531 } }
I20260807 06:47:21.038697 12788 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:21.038733 12788 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:21.038781 12788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:21.039625 12788 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40531 } }
I20260807 06:47:21.039736 12788 leader_election.cc:302] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8ba7bd42c244f3dbcc9f56fc9aed421; no voters:
I20260807 06:47:21.039822 12793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:21.033891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:46375 (local address 127.0.0.1:40531)
0807 06:47:21.034135 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:21.034144 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:21.034178 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:47:21.034836 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:21.034847 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:21.034920 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:21.035088 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:21.035328 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:21.036685 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:21.037540 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:21.038230 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:21.038348 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:21.039108 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:21.039113 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:21.039124 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:21.039331 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:21.039392 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:21.039408 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:21.039504 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:21.039589 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 06:47:21.039622 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":93,"threads_started":1}
I20260807 06:47:21.039907 12788 leader_election.cc:288] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:21.040108 12798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:21.040174 12788 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:21.040338 12798 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [term 1 LEADER]: Becoming Leader. State: Replica: a8ba7bd42c244f3dbcc9f56fc9aed421, State: Running, Role: LEADER
I20260807 06:47:21.040549 12798 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40531 } }
I20260807 06:47:21.040858 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:21.040915 12796 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40531 } } }
I20260807 06:47:21.040980 12796 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:21.041096 12796 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8ba7bd42c244f3dbcc9f56fc9aed421. Latest consensus state: current_term: 1 leader_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba7bd42c244f3dbcc9f56fc9aed421" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40531 } } }
I20260807 06:47:21.041132 12796 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:21.041270 12807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:21.041976 12807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:21.043849 12807 catalog_manager.cc:1347] Generated new cluster ID: 1b4ebae796af4f5994769997bc78176f
I20260807 06:47:21.043901 12807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:21.046187 12793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:21.042606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:53757 (local address 127.0.0.1:40531)
0807 06:47:21.042656 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:21.042657 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:21.042815 (+ 158us) server_negotiation.cc:407] Connection header received
0807 06:47:21.042878 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:21.042879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:21.042889 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:21.042952 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:21.043089 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:21.043796 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:21.044813 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:21.045147 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:21.045235 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:21.045928 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:21.045929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:21.045929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:21.045934 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:21.045949 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:21.045953 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:21.046010 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:21.046104 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 06:47:21.046114 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 06:47:21.056146 12807 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:21.056656 12807 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:21.062500 12807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8ba7bd42c244f3dbcc9f56fc9aed421: Generated new TSK 0
I20260807 06:47:21.062701 12807 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:21.068405 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12686
W20260807 06:47:21.082314 12667 connection.cc:535] client connection to 127.0.0.1:40531 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40531): Connection reset by peer (error 104)
2026-08-07T06:47:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:21 dist-test-slave-8hhm krb5kdc[12829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:21 dist-test-slave-8hhm krb5kdc[12829](info): set up 2 sockets
Aug 07 06:47:21 dist-test-slave-8hhm krb5kdc[12829](info): commencing operation
krb5kdc: starting...
W20260807 06:47:22.305027 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:22 dist-test-slave-8hhm krb5kdc[12829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:22.423357 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32925
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:22.504279 12851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:22.504526 12851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:22.504565 12851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:22.505728 12851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:22.505797 12851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:22.505822 12851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:22.505842 12851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:22.505870 12851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:22.507323 12851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:22.507586 12851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:22.507819 12851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:22.512512 12857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:22.512552 12859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:22.512713 12851 server_base.cc:1034] running on GCE node
W20260807 06:47:22.512753 12863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:22.513023 12851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:22.513355 12851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:22.514513 12851 hybrid_clock.cc:648] HybridClock initialized: now 1786085242514499 us; error 39 us; skew 500 ppm
Aug 07 06:47:22 dist-test-slave-8hhm krb5kdc[12829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:22.516862 12851 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:22.517416 12851 webserver.cc:460] Webserver started at http://127.0.0.1:41351/ using document root <none> and password file <none>
I20260807 06:47:22.517652 12851 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:22.517716 12851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:22.517850 12851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:22.518847 12851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "6e423b5c5a7b4fe199c58f5dedda8db5"
format_stamp: "Formatted at 2026-08-07 06:47:22 on dist-test-slave-8hhm"
server_key: "59969471ed3ef5b931e0b8d070d73e21"
server_key_iv: "f4a8a0532256302d69f913b3ba4440b1"
server_key_version: "encryptionkey@0"
I20260807 06:47:22.519268 12851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "6e423b5c5a7b4fe199c58f5dedda8db5"
format_stamp: "Formatted at 2026-08-07 06:47:22 on dist-test-slave-8hhm"
server_key: "59969471ed3ef5b931e0b8d070d73e21"
server_key_iv: "f4a8a0532256302d69f913b3ba4440b1"
server_key_version: "encryptionkey@0"
I20260807 06:47:22.520556 12851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:22.521339 12872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:22.521521 12851 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:22.521623 12851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "6e423b5c5a7b4fe199c58f5dedda8db5"
format_stamp: "Formatted at 2026-08-07 06:47:22 on dist-test-slave-8hhm"
server_key: "59969471ed3ef5b931e0b8d070d73e21"
server_key_iv: "f4a8a0532256302d69f913b3ba4440b1"
server_key_version: "encryptionkey@0"
I20260807 06:47:22.521704 12851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:22.524855 12851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:22.526648 12851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:22.526800 12851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:22.530846 12851 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32925
I20260807 06:47:22.530875 12946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32925 every 8 connection(s)
I20260807 06:47:22.531193 12851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:22.532125 12947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:22.534343 12947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5: Bootstrap starting.
I20260807 06:47:22.534852 12947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:22.535101 12947 log.cc:824] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:22.535706 12947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5: No bootstrap required, opened a new log
I20260807 06:47:22.537211 12947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260807 06:47:22.537425 12947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:22.537448 12947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e423b5c5a7b4fe199c58f5dedda8db5, State: Initialized, Role: FOLLOWER
I20260807 06:47:22.537541 12947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260807 06:47:22.537590 12947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:22.537608 12947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:22.537633 12947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:22.537940 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 12851
I20260807 06:47:22.538069 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:22.538290 11814 external_mini_cluster.cc:1428] Setting key 73bcbe5bc714df931bca92fa5afd140b
I20260807 06:47:22.538326 12947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260807 06:47:22.538435 12947 leader_election.cc:302] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e423b5c5a7b4fe199c58f5dedda8db5; no voters:
I20260807 06:47:22.538619 12947 leader_election.cc:288] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:22.538666 12953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:22.538861 12953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [term 1 LEADER]: Becoming Leader. State: Replica: 6e423b5c5a7b4fe199c58f5dedda8db5, State: Running, Role: LEADER
I20260807 06:47:22.538866 12947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:22.539041 12953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260807 06:47:22.539525 12958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e423b5c5a7b4fe199c58f5dedda8db5. Latest consensus state: current_term: 1 leader_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } } }
I20260807 06:47:22.539597 12958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:22.540045 12954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e423b5c5a7b4fe199c58f5dedda8db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } } }
I20260807 06:47:22.540136 12954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:22.540604 12963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:22.540956 12960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:22.538990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:48119 (local address 127.0.0.1:32925)
0807 06:47:22.539268 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:22.539278 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:22.539308 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:47:22.539405 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:22.539410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:22.539431 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:22.539879 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:22.540410 (+ 531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:22.540413 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:22.540414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:22.540417 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:22.540454 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:22.540469 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:22.540707 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:22.540740 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 06:47:22.540782 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":69,"threads_started":1}
I20260807 06:47:22.541153 12963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:22.541875 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:22.543681 12963 catalog_manager.cc:1347] Generated new cluster ID: 281a770648cb42b18b70147d78449081
I20260807 06:47:22.543740 12963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:22.544778 12960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:22.543490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:36885 (local address 127.0.0.1:32925)
0807 06:47:22.543530 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:22.543532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:22.543800 (+ 268us) server_negotiation.cc:407] Connection header received
0807 06:47:22.543900 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:22.543901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:22.543906 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:22.543968 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:22.544576 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:22.544577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:22.544577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:22.544581 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:22.544593 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:22.544597 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:22.544647 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:22.544713 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 06:47:22.544724 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:47:22.572346 12963 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:22.572539 12963 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:22.578529 12963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e423b5c5a7b4fe199c58f5dedda8db5: Generated new TSK 0
I20260807 06:47:22.578724 12963 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:22.582389 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 12851
2026-08-07T06:47:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1515 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:22 dist-test-slave-8hhm krb5kdc[12993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:22 dist-test-slave-8hhm krb5kdc[12993](info): set up 2 sockets
Aug 07 06:47:22 dist-test-slave-8hhm krb5kdc[12993](info): commencing operation
krb5kdc: starting...
W20260807 06:47:23.820616 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:23 dist-test-slave-8hhm krb5kdc[12993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:23.946367 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34461
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:24.026576 13012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:24.026770 13012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:24.026793 13012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:24.027892 13012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:24.027925 13012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:24.027938 13012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:24.027951 13012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:24.027962 13012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:24.029318 13012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34461
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:24.029492 13012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:24.029651 13012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:24.034396 13029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:24.034478 13025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:24.034642 13012 server_base.cc:1034] running on GCE node
W20260807 06:47:24.034401 13024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:24.034950 13012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:24.035267 13012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:24.036433 13012 hybrid_clock.cc:648] HybridClock initialized: now 1786085244036418 us; error 28 us; skew 500 ppm
Aug 07 06:47:24 dist-test-slave-8hhm krb5kdc[12993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085244, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:24.038919 13012 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:24.039332 13012 webserver.cc:460] Webserver started at http://127.0.0.1:45929/ using document root <none> and password file <none>
I20260807 06:47:24.039549 13012 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:24.039616 13012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:24.039762 13012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:24.040771 13012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "f1de2cde9ffd4e57bdd292f12873a99b"
format_stamp: "Formatted at 2026-08-07 06:47:24 on dist-test-slave-8hhm"
server_key: "d302445b15ed49a9f40f3faea4a51ee8"
server_key_iv: "a103ca75d6d6b34a2bcc147c34a94c73"
server_key_version: "encryptionkey@0"
I20260807 06:47:24.041144 13012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "f1de2cde9ffd4e57bdd292f12873a99b"
format_stamp: "Formatted at 2026-08-07 06:47:24 on dist-test-slave-8hhm"
server_key: "d302445b15ed49a9f40f3faea4a51ee8"
server_key_iv: "a103ca75d6d6b34a2bcc147c34a94c73"
server_key_version: "encryptionkey@0"
I20260807 06:47:24.042502 13012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:24.043210 13038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:24.043373 13012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:24.043468 13012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "f1de2cde9ffd4e57bdd292f12873a99b"
format_stamp: "Formatted at 2026-08-07 06:47:24 on dist-test-slave-8hhm"
server_key: "d302445b15ed49a9f40f3faea4a51ee8"
server_key_iv: "a103ca75d6d6b34a2bcc147c34a94c73"
server_key_version: "encryptionkey@0"
I20260807 06:47:24.043545 13012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:24.069810 13012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:24.071755 13012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:24.071916 13012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:24.076076 13012 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34461
I20260807 06:47:24.076112 13110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34461 every 8 connection(s)
I20260807 06:47:24.076494 13012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:24.077447 13113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:24.079700 13113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b: Bootstrap starting.
I20260807 06:47:24.080238 13113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:24.080469 13113 log.cc:824] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:24.081125 13113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b: No bootstrap required, opened a new log
I20260807 06:47:24.081532 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13012
I20260807 06:47:24.081660 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:24.081841 11814 external_mini_cluster.cc:1428] Setting key f9286e713fc76383de2515848e8f34c2
I20260807 06:47:24.083127 13113 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34461 } }
I20260807 06:47:24.083302 13113 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:24.083405 13113 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1de2cde9ffd4e57bdd292f12873a99b, State: Initialized, Role: FOLLOWER
I20260807 06:47:24.083552 13113 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34461 } }
I20260807 06:47:24.083642 13113 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:24.083681 13113 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:24.083738 13113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:24.084687 13113 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34461 } }
I20260807 06:47:24.084810 13113 leader_election.cc:302] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1de2cde9ffd4e57bdd292f12873a99b; no voters:
I20260807 06:47:24.084987 13113 leader_election.cc:288] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:24.085009 13121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:24.085157 13121 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [term 1 LEADER]: Becoming Leader. State: Replica: f1de2cde9ffd4e57bdd292f12873a99b, State: Running, Role: LEADER
I20260807 06:47:24.085269 13121 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34461 } }
I20260807 06:47:24.085318 13113 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:24.085621 13121 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34461 } } }
I20260807 06:47:24.085762 13121 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:24.085951 13121 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1de2cde9ffd4e57bdd292f12873a99b. Latest consensus state: current_term: 1 leader_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1de2cde9ffd4e57bdd292f12873a99b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34461 } } }
I20260807 06:47:24.086062 13121 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:24.086359 13136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:24.086907 13136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:24.088435 13136 catalog_manager.cc:1347] Generated new cluster ID: bdddd9c33e824567a0a6590fbe2cc6bb
I20260807 06:47:24.088490 13136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:47:24 dist-test-slave-8hhm krb5kdc[12993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:47:24.093267 13120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:24.082343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:32977 (local address 127.0.0.1:34461)
0807 06:47:24.082505 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:24.082512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:24.082535 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:47:24.083101 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:24.083107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:24.083152 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:24.083259 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:24.084097 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:24.085039 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:24.086139 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:24.086770 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:24.086873 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:24.089972 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:24.089977 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:24.089977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:24.089988 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:24.091674 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:24.092087 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:24.092090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:24.092094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:24.092204 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:24.092433 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:24.092434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:24.092434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:24.092656 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:24.092851 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:24.092937 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 06:47:24.093040 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260807 06:47:24.094218 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:24.097617 13136 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:24.098238 13136 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:24.101521 13120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:24.095474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:46569 (local address 127.0.0.1:34461)
0807 06:47:24.095511 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:24.095513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:24.095629 (+ 116us) server_negotiation.cc:407] Connection header received
0807 06:47:24.095709 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:24.095710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:24.095720 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:24.095774 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:24.096270 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:24.096738 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:24.097548 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:24.097845 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:24.097913 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:24.098949 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:24.098950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:24.098951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:24.098957 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:24.100309 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:24.100710 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:24.100711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:24.100712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:24.100765 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:24.100981 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:24.100982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:24.100982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:24.101083 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:24.101205 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:24.101359 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 06:47:24.101420 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:47:24.104821 13136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1de2cde9ffd4e57bdd292f12873a99b: Generated new TSK 0
I20260807 06:47:24.104992 13136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:24.106907 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13012
W20260807 06:47:24.121454 12987 connection.cc:535] client connection to 127.0.0.1:34461 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34461): Connection reset by peer (error 104)
2026-08-07T06:47:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1523 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:24 dist-test-slave-8hhm krb5kdc[13163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:24 dist-test-slave-8hhm krb5kdc[13163](info): set up 2 sockets
Aug 07 06:47:24 dist-test-slave-8hhm krb5kdc[13163](info): commencing operation
krb5kdc: starting...
W20260807 06:47:25.374135 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:25 dist-test-slave-8hhm krb5kdc[13163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:25.499791 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36955
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:25.581734 13183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:25.581979 13183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:25.582000 13183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:25.583170 13183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:25.583225 13183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:25.583240 13183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:25.583292 13183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:25.583316 13183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:25.584748 13183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36955
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:25.584978 13183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:25.585192 13183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:25.590155 13192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:25.590152 13194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:25.590222 13189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:25.590233 13183 server_base.cc:1034] running on GCE node
I20260807 06:47:25.590615 13183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:25.590927 13183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:25.592084 13183 hybrid_clock.cc:648] HybridClock initialized: now 1786085245592076 us; error 37 us; skew 500 ppm
Aug 07 06:47:25 dist-test-slave-8hhm krb5kdc[13163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085245, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:25.594677 13183 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:25.595062 13183 webserver.cc:460] Webserver started at http://127.0.0.1:42895/ using document root <none> and password file <none>
I20260807 06:47:25.595289 13183 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:25.595335 13183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:25.595470 13183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:25.596489 13183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "893ab0f2368f4765b99b358518f93a6a"
format_stamp: "Formatted at 2026-08-07 06:47:25 on dist-test-slave-8hhm"
server_key: "da2b99e857e20d7f53abbe02d3df4157"
server_key_iv: "06d0abb2758c24c616040d1aba0babe4"
server_key_version: "encryptionkey@0"
I20260807 06:47:25.596854 13183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "893ab0f2368f4765b99b358518f93a6a"
format_stamp: "Formatted at 2026-08-07 06:47:25 on dist-test-slave-8hhm"
server_key: "da2b99e857e20d7f53abbe02d3df4157"
server_key_iv: "06d0abb2758c24c616040d1aba0babe4"
server_key_version: "encryptionkey@0"
I20260807 06:47:25.598273 13183 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:25.598960 13202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:25.599152 13183 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:25.599254 13183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "893ab0f2368f4765b99b358518f93a6a"
format_stamp: "Formatted at 2026-08-07 06:47:25 on dist-test-slave-8hhm"
server_key: "da2b99e857e20d7f53abbe02d3df4157"
server_key_iv: "06d0abb2758c24c616040d1aba0babe4"
server_key_version: "encryptionkey@0"
I20260807 06:47:25.599325 13183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:25.612993 13183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:25.614985 13183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:25.615131 13183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:25.619071 13183 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36955
I20260807 06:47:25.619117 13281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36955 every 8 connection(s)
I20260807 06:47:25.619489 13183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:25.620371 13282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:25.622694 13282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a: Bootstrap starting.
I20260807 06:47:25.623250 13282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:25.623481 13282 log.cc:824] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:25.624155 13282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a: No bootstrap required, opened a new log
I20260807 06:47:25.624802 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13183
I20260807 06:47:25.624920 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:25.625103 11814 external_mini_cluster.cc:1428] Setting key f001b3c27dc8275579819428f9f56b7d
I20260807 06:47:25.626293 13282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893ab0f2368f4765b99b358518f93a6a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36955 } }
I20260807 06:47:25.626466 13282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:25.626575 13282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 893ab0f2368f4765b99b358518f93a6a, State: Initialized, Role: FOLLOWER
I20260807 06:47:25.626727 13282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893ab0f2368f4765b99b358518f93a6a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36955 } }
I20260807 06:47:25.626804 13282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:25.626827 13282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:25.626888 13282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:25.627396 13282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893ab0f2368f4765b99b358518f93a6a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36955 } }
I20260807 06:47:25.627509 13282 leader_election.cc:302] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 893ab0f2368f4765b99b358518f93a6a; no voters:
I20260807 06:47:25.627661 13282 leader_election.cc:288] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:25.627684 13290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:25.627794 13290 raft_consensus.cc:686] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [term 1 LEADER]: Becoming Leader. State: Replica: 893ab0f2368f4765b99b358518f93a6a, State: Running, Role: LEADER
I20260807 06:47:25.627911 13282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:25.627893 13290 consensus_queue.cc:237] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893ab0f2368f4765b99b358518f93a6a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36955 } }
I20260807 06:47:25.628367 13290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 893ab0f2368f4765b99b358518f93a6a. Latest consensus state: current_term: 1 leader_uuid: "893ab0f2368f4765b99b358518f93a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893ab0f2368f4765b99b358518f93a6a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36955 } } }
I20260807 06:47:25.628456 13290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:25.628623 13292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "893ab0f2368f4765b99b358518f93a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "893ab0f2368f4765b99b358518f93a6a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36955 } } }
I20260807 06:47:25.628710 13292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:25.628852 13297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:25.629370 13297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:25.631340 13297 catalog_manager.cc:1347] Generated new cluster ID: bafebe23e97e426bac2cf0d27bb6bfba
I20260807 06:47:25.631399 13297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:25.632004 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:25.625635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:60073 (local address 127.0.0.1:36955)
0807 06:47:25.625853 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:25.625862 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:25.625896 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:47:25.626252 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:25.626260 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:25.626324 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:25.626475 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:25.626743 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:25.628658 (+ 1915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:25.629793 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:25.630535 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:25.630789 (+ 254us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:25.631305 (+ 516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:25.631309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:25.631309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:25.631525 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:25.631563 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:25.631577 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:25.631657 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:25.631774 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 06:47:25.631799 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260807 06:47:25.634100 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:25.645633 13297 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:25.646153 13297 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:25.649379 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:25.635651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:52363 (local address 127.0.0.1:36955)
0807 06:47:25.635689 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:25.635691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:25.645313 (+ 9622us) server_negotiation.cc:407] Connection header received
0807 06:47:25.645385 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:25.645386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:25.645401 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:25.645470 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:25.646315 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:25.647044 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:25.648018 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:25.648329 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:25.648401 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:25.649098 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:25.649100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:25.649100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:25.649104 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:25.649120 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:25.649124 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:25.649187 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:25.649287 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 06:47:25.649301 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:47:25.654359 13297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 893ab0f2368f4765b99b358518f93a6a: Generated new TSK 0
I20260807 06:47:25.654569 13297 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:25.660377 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13183
W20260807 06:47:25.681833 13161 connection.cc:535] client connection to 127.0.0.1:36955 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36955): Connection reset by peer (error 104)
2026-08-07T06:47:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1560 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:25 dist-test-slave-8hhm krb5kdc[13323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:25 dist-test-slave-8hhm krb5kdc[13323](info): set up 2 sockets
Aug 07 06:47:25 dist-test-slave-8hhm krb5kdc[13323](info): commencing operation
krb5kdc: starting...
W20260807 06:47:26.914813 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:26 dist-test-slave-8hhm krb5kdc[13323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:47:27.031881 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:27.113291 13343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:27.113474 13343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:27.113497 13343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:27.114607 13343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:27.114648 13343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:27.114661 13343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:27.114708 13343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:27.114727 13343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:27.116251 13343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40121
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:27.116477 13343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:27.116694 13343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:27.121513 13352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:27.121523 13353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:27.121601 13356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:27.121766 13343 server_base.cc:1034] running on GCE node
I20260807 06:47:27.122040 13343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:27.122344 13343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:27.123482 13343 hybrid_clock.cc:648] HybridClock initialized: now 1786085247123472 us; error 27 us; skew 500 ppm
Aug 07 06:47:27 dist-test-slave-8hhm krb5kdc[13323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085247, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:27.125973 13343 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:47:27.126474 13343 webserver.cc:460] Webserver started at http://127.0.0.1:45403/ using document root <none> and password file <none>
I20260807 06:47:27.126726 13343 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:27.126797 13343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:27.126983 13343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:27.128064 13343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "9d6247f40d01496c844da3aefe7319b8"
format_stamp: "Formatted at 2026-08-07 06:47:27 on dist-test-slave-8hhm"
server_key: "4aeea81bd8cd44284373923aaebe196a"
server_key_iv: "0ef639456a07620259c0f1f23fc87ffe"
server_key_version: "encryptionkey@0"
I20260807 06:47:27.128450 13343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "9d6247f40d01496c844da3aefe7319b8"
format_stamp: "Formatted at 2026-08-07 06:47:27 on dist-test-slave-8hhm"
server_key: "4aeea81bd8cd44284373923aaebe196a"
server_key_iv: "0ef639456a07620259c0f1f23fc87ffe"
server_key_version: "encryptionkey@0"
I20260807 06:47:27.129921 13343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:27.130749 13365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:27.130937 13343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:27.131085 13343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "9d6247f40d01496c844da3aefe7319b8"
format_stamp: "Formatted at 2026-08-07 06:47:27 on dist-test-slave-8hhm"
server_key: "4aeea81bd8cd44284373923aaebe196a"
server_key_iv: "0ef639456a07620259c0f1f23fc87ffe"
server_key_version: "encryptionkey@0"
I20260807 06:47:27.131165 13343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:27.134704 13343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:27.136684 13343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:27.136844 13343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:27.141191 13343 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40121
I20260807 06:47:27.141269 13443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40121 every 8 connection(s)
I20260807 06:47:27.141618 13343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:27.142594 13444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:27.144755 13444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8: Bootstrap starting.
I20260807 06:47:27.145347 13444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:27.145617 13444 log.cc:824] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:27.146237 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13343
I20260807 06:47:27.146275 13444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8: No bootstrap required, opened a new log
I20260807 06:47:27.146376 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:27.146585 11814 external_mini_cluster.cc:1428] Setting key 60c48231f2e76e026959b81084943340
I20260807 06:47:27.148283 13444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d6247f40d01496c844da3aefe7319b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40121 } }
I20260807 06:47:27.148448 13444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:27.148514 13444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6247f40d01496c844da3aefe7319b8, State: Initialized, Role: FOLLOWER
I20260807 06:47:27.148659 13444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d6247f40d01496c844da3aefe7319b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40121 } }
I20260807 06:47:27.148761 13444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:27.148835 13444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:27.148897 13444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:27.149585 13451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:27.147158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:33623 (local address 127.0.0.1:40121)
0807 06:47:27.147352 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:27.147360 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:27.147391 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:47:27.148253 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:27.148273 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:27.148300 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:27.148418 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:27.149148 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:27.149152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:27.149152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:27.149156 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:27.149199 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:27.149243 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:27.149308 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:27.149380 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 06:47:27.149422 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260807 06:47:27.150032 13444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d6247f40d01496c844da3aefe7319b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40121 } }
I20260807 06:47:27.150148 13444 leader_election.cc:302] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d6247f40d01496c844da3aefe7319b8; no voters:
I20260807 06:47:27.150300 13444 leader_election.cc:288] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:27.150408 13452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:27.150463 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:27.150538 13444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:27.150583 13452 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [term 1 LEADER]: Becoming Leader. State: Replica: 9d6247f40d01496c844da3aefe7319b8, State: Running, Role: LEADER
I20260807 06:47:27.150660 13452 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d6247f40d01496c844da3aefe7319b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40121 } }
I20260807 06:47:27.151010 13453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d6247f40d01496c844da3aefe7319b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d6247f40d01496c844da3aefe7319b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40121 } } }
I20260807 06:47:27.151116 13453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:27.151281 13454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d6247f40d01496c844da3aefe7319b8. Latest consensus state: current_term: 1 leader_uuid: "9d6247f40d01496c844da3aefe7319b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d6247f40d01496c844da3aefe7319b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40121 } } }
I20260807 06:47:27.151351 13454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:27.151748 13466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:27.152254 13466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:27.153448 13451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:27.152159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:35673 (local address 127.0.0.1:40121)
0807 06:47:27.152237 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:27.152239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:27.152416 (+ 177us) server_negotiation.cc:407] Connection header received
0807 06:47:27.152490 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:27.152491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:27.152506 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:27.152564 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:27.153200 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:27.153201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:27.153201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:27.153206 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:27.153237 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:27.153242 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:27.153294 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:27.153355 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 06:47:27.153369 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:47:27.154088 13466 catalog_manager.cc:1347] Generated new cluster ID: 7a85ca1ca7334702ab4a4769d3e1a883
I20260807 06:47:27.154138 13466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:27.162271 13466 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:27.162428 13466 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:27.172003 13466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d6247f40d01496c844da3aefe7319b8: Generated new TSK 0
I20260807 06:47:27.172175 13466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:27.176007 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13343
2026-08-07T06:47:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1514 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:27 dist-test-slave-8hhm krb5kdc[13488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:27 dist-test-slave-8hhm krb5kdc[13488](info): set up 2 sockets
Aug 07 06:47:27 dist-test-slave-8hhm krb5kdc[13488](info): commencing operation
krb5kdc: starting...
W20260807 06:47:28.428936 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:28 dist-test-slave-8hhm krb5kdc[13488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:28.552052 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36487
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:36487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:28.633005 13506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:28.633191 13506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:28.633265 13506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:28.634361 13506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:28.634395 13506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:28.634408 13506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:28.634420 13506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:28.634433 13506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:28.635804 13506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:36487
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:36487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:28.636044 13506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:28.636226 13506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:28.641188 13516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:28.641278 13520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:28.641199 13515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:28.641367 13506 server_base.cc:1034] running on GCE node
I20260807 06:47:28.641690 13506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:28.641979 13506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:28.643119 13506 hybrid_clock.cc:648] HybridClock initialized: now 1786085248643102 us; error 39 us; skew 500 ppm
Aug 07 06:47:28 dist-test-slave-8hhm krb5kdc[13488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085248, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:28.645707 13506 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:28.646181 13506 webserver.cc:460] Webserver started at http://127.11.137.190:42893/ using document root <none> and password file <none>
I20260807 06:47:28.646377 13506 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:28.646418 13506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:28.646505 13506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:28.647445 13506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "4aa3718971eb4ad785abdcace32e4908"
format_stamp: "Formatted at 2026-08-07 06:47:28 on dist-test-slave-8hhm"
server_key: "097f3005818fb79511db5fceb76c7013"
server_key_iv: "fb4baa0ae68c9ccd8f249f1ecf72306d"
server_key_version: "encryptionkey@0"
I20260807 06:47:28.647740 13506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "4aa3718971eb4ad785abdcace32e4908"
format_stamp: "Formatted at 2026-08-07 06:47:28 on dist-test-slave-8hhm"
server_key: "097f3005818fb79511db5fceb76c7013"
server_key_iv: "fb4baa0ae68c9ccd8f249f1ecf72306d"
server_key_version: "encryptionkey@0"
I20260807 06:47:28.648986 13506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 06:47:28.649739 13530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:28.649911 13506 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:28.650018 13506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "4aa3718971eb4ad785abdcace32e4908"
format_stamp: "Formatted at 2026-08-07 06:47:28 on dist-test-slave-8hhm"
server_key: "097f3005818fb79511db5fceb76c7013"
server_key_iv: "fb4baa0ae68c9ccd8f249f1ecf72306d"
server_key_version: "encryptionkey@0"
I20260807 06:47:28.650115 13506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:28.663040 13506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:28.665280 13506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:28.665431 13506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:28.669664 13506 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:36487
I20260807 06:47:28.669715 13601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:36487 every 8 connection(s)
I20260807 06:47:28.670042 13506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:28.670909 13602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:28.673316 13602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908: Bootstrap starting.
I20260807 06:47:28.673925 13602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:28.674243 13602 log.cc:824] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:28.674948 13602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908: No bootstrap required, opened a new log
I20260807 06:47:28.676609 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13506
I20260807 06:47:28.676743 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:28.676822 13602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa3718971eb4ad785abdcace32e4908" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36487 } }
I20260807 06:47:28.676962 11814 external_mini_cluster.cc:1428] Setting key 23551a2faba59dbf3bf175e49d465a39
I20260807 06:47:28.677004 13602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:28.677058 13602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa3718971eb4ad785abdcace32e4908, State: Initialized, Role: FOLLOWER
I20260807 06:47:28.677251 13602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa3718971eb4ad785abdcace32e4908" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36487 } }
I20260807 06:47:28.677361 13602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:28.677412 13602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:28.677476 13602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:28.678068 13602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa3718971eb4ad785abdcace32e4908" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36487 } }
I20260807 06:47:28.678164 13602 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa3718971eb4ad785abdcace32e4908; no voters:
I20260807 06:47:28.678378 13602 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:28.678411 13607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:28.678607 13607 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [term 1 LEADER]: Becoming Leader. State: Replica: 4aa3718971eb4ad785abdcace32e4908, State: Running, Role: LEADER
I20260807 06:47:28.678668 13602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:28.678738 13607 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa3718971eb4ad785abdcace32e4908" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36487 } }
I20260807 06:47:28.679090 13607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa3718971eb4ad785abdcace32e4908. Latest consensus state: current_term: 1 leader_uuid: "4aa3718971eb4ad785abdcace32e4908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa3718971eb4ad785abdcace32e4908" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36487 } } }
I20260807 06:47:28.679194 13607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:28.679442 13618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:28.679965 13618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:28.681020 13608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aa3718971eb4ad785abdcace32e4908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa3718971eb4ad785abdcace32e4908" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 36487 } } }
I20260807 06:47:28.681109 13608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:28.682003 13618 catalog_manager.cc:1347] Generated new cluster ID: ca2af67ae79c4ea39a6d0a32441eec0b
I20260807 06:47:28.682061 13618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 06:47:28 dist-test-slave-8hhm krb5kdc[13488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:28.688402 13606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:28.677472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40325 (local address 127.11.137.190:36487)
0807 06:47:28.677679 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:28.677689 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:28.677731 (+ 42us) server_negotiation.cc:407] Connection header received
0807 06:47:28.678050 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:28.678056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:28.678097 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:28.678252 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:28.679088 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:28.680581 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:28.681645 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:28.682195 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:28.682331 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:28.684854 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:28.684857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:28.684858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:28.684870 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:28.686718 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:28.687175 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:28.687183 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:28.687183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:28.687290 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:28.687551 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:28.687552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:28.687552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:28.687795 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:28.687995 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:28.688136 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 06:47:28.688243 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260807 06:47:28.689431 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:28.708079 13606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:28.701538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39373 (local address 127.11.137.190:36487)
0807 06:47:28.701581 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:28.701583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:28.701761 (+ 178us) server_negotiation.cc:407] Connection header received
0807 06:47:28.701844 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:28.701845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:28.701855 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:28.701917 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:28.702500 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:28.702986 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:28.703705 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:28.703947 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:28.704045 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:28.705343 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:28.705345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:28.705345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:28.705352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:28.706818 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:28.707219 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:28.707220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:28.707220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:28.707282 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:28.707523 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:28.707524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:28.707524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:28.707638 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:28.707775 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:28.707902 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 06:47:28.707967 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":21}
I20260807 06:47:28.713285 13618 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:28.713792 13618 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:28.719789 13618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aa3718971eb4ad785abdcace32e4908: Generated new TSK 0
I20260807 06:47:28.719972 13618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:28.723281 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13506
W20260807 06:47:28.739419 13483 connection.cc:535] client connection to 127.11.137.190:36487 recv error: Network error: failed to read from TLS socket (remote: 127.11.137.190:36487): Connection reset by peer (error 104)
2026-08-07T06:47:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1543 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:28 dist-test-slave-8hhm krb5kdc[13645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:28 dist-test-slave-8hhm krb5kdc[13645](info): set up 2 sockets
Aug 07 06:47:28 dist-test-slave-8hhm krb5kdc[13645](info): commencing operation
krb5kdc: starting...
W20260807 06:47:29.980600 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:30 dist-test-slave-8hhm krb5kdc[13645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:30.104127 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42531
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:34301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:42531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:30.185848 13665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:30.186044 13665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:30.186065 13665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:30.187124 13665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:30.187157 13665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:30.187177 13665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:30.187191 13665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:30.187202 13665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:30.188879 13665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:34301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:42531
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:42531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:30.189117 13665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:30.189363 13665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:30.194271 13673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:30.194317 13676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:30.194327 13674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:30.194494 13665 server_base.cc:1034] running on GCE node
I20260807 06:47:30.194811 13665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:30.195139 13665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:30.196308 13665 hybrid_clock.cc:648] HybridClock initialized: now 1786085250196295 us; error 41 us; skew 500 ppm
Aug 07 06:47:30 dist-test-slave-8hhm krb5kdc[13645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085250, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:30.198889 13665 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:30.199347 13665 webserver.cc:460] Webserver started at http://127.11.137.190:35313/ using document root <none> and password file <none>
I20260807 06:47:30.199586 13665 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:30.199652 13665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:30.199815 13665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:30.200857 13665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "6515375ad4194470a304fe7215f0ede1"
format_stamp: "Formatted at 2026-08-07 06:47:30 on dist-test-slave-8hhm"
server_key: "4e21a521669fb0867fdda2996bb78714"
server_key_iv: "7a688b31b1cb6bbbf447fa5b245f729d"
server_key_version: "encryptionkey@0"
I20260807 06:47:30.201287 13665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "6515375ad4194470a304fe7215f0ede1"
format_stamp: "Formatted at 2026-08-07 06:47:30 on dist-test-slave-8hhm"
server_key: "4e21a521669fb0867fdda2996bb78714"
server_key_iv: "7a688b31b1cb6bbbf447fa5b245f729d"
server_key_version: "encryptionkey@0"
I20260807 06:47:30.202688 13665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:30.203434 13684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:30.203639 13665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:30.203752 13665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "6515375ad4194470a304fe7215f0ede1"
format_stamp: "Formatted at 2026-08-07 06:47:30 on dist-test-slave-8hhm"
server_key: "4e21a521669fb0867fdda2996bb78714"
server_key_iv: "7a688b31b1cb6bbbf447fa5b245f729d"
server_key_version: "encryptionkey@0"
I20260807 06:47:30.203842 13665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:30.215456 13665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:30.217805 13665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:30.217965 13665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:30.222329 13665 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:42531
I20260807 06:47:30.222381 13769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:42531 every 8 connection(s)
I20260807 06:47:30.222740 13665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:30.223652 13770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:30.226066 13770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1: Bootstrap starting.
I20260807 06:47:30.226673 13770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:30.226979 13770 log.cc:824] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:30.227754 13770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1: No bootstrap required, opened a new log
I20260807 06:47:30.228727 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13665
I20260807 06:47:30.228832 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:30.229043 11814 external_mini_cluster.cc:1428] Setting key 640b8f0b4cb59aac55f788b3419dad3e
I20260807 06:47:30.229786 13770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6515375ad4194470a304fe7215f0ede1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42531 } }
I20260807 06:47:30.229964 13770 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:30.230010 13770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6515375ad4194470a304fe7215f0ede1, State: Initialized, Role: FOLLOWER
I20260807 06:47:30.230154 13770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6515375ad4194470a304fe7215f0ede1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42531 } }
I20260807 06:47:30.230235 13770 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:30.230309 13770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:30.230361 13770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:30.230926 13770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6515375ad4194470a304fe7215f0ede1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42531 } }
I20260807 06:47:30.231050 13770 leader_election.cc:302] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6515375ad4194470a304fe7215f0ede1; no voters:
I20260807 06:47:30.231241 13770 leader_election.cc:288] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:30.231268 13775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:30.231451 13775 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [term 1 LEADER]: Becoming Leader. State: Replica: 6515375ad4194470a304fe7215f0ede1, State: Running, Role: LEADER
I20260807 06:47:30.231527 13770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:30.231621 13775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6515375ad4194470a304fe7215f0ede1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42531 } }
I20260807 06:47:30.232049 13775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6515375ad4194470a304fe7215f0ede1. Latest consensus state: current_term: 1 leader_uuid: "6515375ad4194470a304fe7215f0ede1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6515375ad4194470a304fe7215f0ede1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42531 } } }
I20260807 06:47:30.232311 13775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:30.232224 13777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6515375ad4194470a304fe7215f0ede1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6515375ad4194470a304fe7215f0ede1" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 42531 } } }
I20260807 06:47:30.232749 13777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:30.232915 13787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:30.233655 13787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:30.235184 13774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:30.229643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53331 (local address 127.11.137.190:42531)
0807 06:47:30.229855 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:30.229866 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:30.229901 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:47:30.230017 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:30.230025 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:30.230079 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:30.230220 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:30.230614 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:30.231816 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:30.233049 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:30.233589 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:30.233720 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:30.234427 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:30.234431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:30.234431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:30.234611 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:30.234668 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:30.234683 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:30.234769 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:30.234912 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 06:47:30.234941 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
I20260807 06:47:30.235934 13787 catalog_manager.cc:1347] Generated new cluster ID: 4dcbd5bab284400bb149e0574a11eca2
I20260807 06:47:30.235986 13787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:30.243724 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:30.244753 13787 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:30.245555 13787 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:30.248849 13774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:30.245177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46253 (local address 127.11.137.190:42531)
0807 06:47:30.245245 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:30.245247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:30.245370 (+ 123us) server_negotiation.cc:407] Connection header received
0807 06:47:30.245427 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:30.245428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:30.245553 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:30.245624 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:30.245783 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:30.246501 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:30.247559 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:30.247853 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:30.247911 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:30.248595 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:30.248596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:30.248596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:30.248600 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:30.248615 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:30.248619 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:30.248673 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:30.248765 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 06:47:30.248779 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 06:47:30.252821 13787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6515375ad4194470a304fe7215f0ede1: Generated new TSK 0
I20260807 06:47:30.253002 13787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:30.258831 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13665
W20260807 06:47:30.274392 13643 connection.cc:535] client connection to 127.11.137.190:42531 recv error: Network error: failed to read from TLS socket (remote: 127.11.137.190:42531): Connection reset by peer (error 104)
2026-08-07T06:47:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1535 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:30 dist-test-slave-8hhm krb5kdc[13807](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:30 dist-test-slave-8hhm krb5kdc[13807](info): set up 2 sockets
Aug 07 06:47:30 dist-test-slave-8hhm krb5kdc[13807](info): commencing operation
krb5kdc: starting...
W20260807 06:47:31.500118 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:31 dist-test-slave-8hhm krb5kdc[13807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:31.622394 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:37795
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:37795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:31.704306 13828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:31.704532 13828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:31.704582 13828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:31.705791 13828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:31.705854 13828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:31.705878 13828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:31.705899 13828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:31.705927 13828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:31.707350 13828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:37795
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:37795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:31.707630 13828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:31.707844 13828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:31.712720 13840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:31.712744 13834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:31.712766 13828 server_base.cc:1034] running on GCE node
W20260807 06:47:31.712736 13836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:31.713176 13828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:31.713502 13828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:31.714648 13828 hybrid_clock.cc:648] HybridClock initialized: now 1786085251714638 us; error 33 us; skew 500 ppm
Aug 07 06:47:31 dist-test-slave-8hhm krb5kdc[13807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085251, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:31.721351 13828 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:31.721796 13828 webserver.cc:460] Webserver started at http://127.11.137.190:45819/ using document root <none> and password file <none>
I20260807 06:47:31.722018 13828 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:31.722112 13828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:31.722261 13828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:31.723241 13828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "f8f6db0056cf4f6694d32617045e4f7c"
format_stamp: "Formatted at 2026-08-07 06:47:31 on dist-test-slave-8hhm"
server_key: "fdd399db287d8fd1841b28133c71099d"
server_key_iv: "acc5de85d8a931cef03514dae11ab125"
server_key_version: "encryptionkey@0"
I20260807 06:47:31.723594 13828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "f8f6db0056cf4f6694d32617045e4f7c"
format_stamp: "Formatted at 2026-08-07 06:47:31 on dist-test-slave-8hhm"
server_key: "fdd399db287d8fd1841b28133c71099d"
server_key_iv: "acc5de85d8a931cef03514dae11ab125"
server_key_version: "encryptionkey@0"
I20260807 06:47:31.724952 13828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:31.725750 13851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:31.725924 13828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:31.726023 13828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "f8f6db0056cf4f6694d32617045e4f7c"
format_stamp: "Formatted at 2026-08-07 06:47:31 on dist-test-slave-8hhm"
server_key: "fdd399db287d8fd1841b28133c71099d"
server_key_iv: "acc5de85d8a931cef03514dae11ab125"
server_key_version: "encryptionkey@0"
I20260807 06:47:31.726127 13828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:31.729279 13828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:31.731501 13828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:31.731665 13828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:31.735594 13828 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:37795
I20260807 06:47:31.735625 13925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:37795 every 8 connection(s)
I20260807 06:47:31.735934 13828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:31.736896 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:31.737011 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13828
I20260807 06:47:31.737149 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:31.737378 11814 external_mini_cluster.cc:1428] Setting key d7f9b3f10257a5fbae310239165b23b7
I20260807 06:47:31.739668 13930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:31.737859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40983 (local address 127.11.137.190:37795)
0807 06:47:31.738031 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:31.738038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:31.738067 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:47:31.738468 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:31.738473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:31.738495 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:31.738602 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:31.739215 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:31.739218 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:31.739218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:31.739222 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:31.739268 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:31.739277 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:31.739333 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:31.739431 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 06:47:31.739459 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260807 06:47:31.740489 13927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c: Bootstrap starting.
I20260807 06:47:31.740692 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:31.741245 13927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:31.741586 13927 log.cc:824] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:31.742288 13927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c: No bootstrap required, opened a new log
I20260807 06:47:31.743285 13930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:31.742362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59161 (local address 127.11.137.190:37795)
0807 06:47:31.742413 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:31.742415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:31.742517 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:47:31.742573 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:31.742574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:31.742578 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:31.742634 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:31.743090 (+ 456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:31.743091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:31.743091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:31.743095 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:31.743108 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:31.743112 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:31.743177 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:31.743212 (+ 35us) server_negotiation.cc:299] Negotiation successful
0807 06:47:31.743223 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:47:31.744602 13927 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f6db0056cf4f6694d32617045e4f7c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37795 } }
I20260807 06:47:31.744731 13927 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:31.744753 13927 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f6db0056cf4f6694d32617045e4f7c, State: Initialized, Role: FOLLOWER
I20260807 06:47:31.744899 13927 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f6db0056cf4f6694d32617045e4f7c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37795 } }
I20260807 06:47:31.744980 13927 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:31.745023 13927 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:31.745072 13927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:31.745653 13927 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f6db0056cf4f6694d32617045e4f7c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37795 } }
I20260807 06:47:31.745769 13927 leader_election.cc:302] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8f6db0056cf4f6694d32617045e4f7c; no voters:
I20260807 06:47:31.745925 13927 leader_election.cc:288] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:31.745990 13940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:31.746165 13940 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [term 1 LEADER]: Becoming Leader. State: Replica: f8f6db0056cf4f6694d32617045e4f7c, State: Running, Role: LEADER
I20260807 06:47:31.746188 13927 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:31.746304 13940 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f6db0056cf4f6694d32617045e4f7c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37795 } }
I20260807 06:47:31.746704 13941 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8f6db0056cf4f6694d32617045e4f7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f6db0056cf4f6694d32617045e4f7c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37795 } } }
I20260807 06:47:31.746712 13942 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8f6db0056cf4f6694d32617045e4f7c. Latest consensus state: current_term: 1 leader_uuid: "f8f6db0056cf4f6694d32617045e4f7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f6db0056cf4f6694d32617045e4f7c" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 37795 } } }
I20260807 06:47:31.746902 13942 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:31.747176 13941 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:31.747351 13951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:31.747828 13951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:31.749419 13951 catalog_manager.cc:1347] Generated new cluster ID: 7f2393705d6f4662830cbac8352a99d2
I20260807 06:47:31.749492 13951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:31.761317 13951 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:31.761483 13951 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:31.764912 13951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8f6db0056cf4f6694d32617045e4f7c: Generated new TSK 0
I20260807 06:47:31.765110 13951 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:31.773561 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13828
2026-08-07T06:47:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:31 dist-test-slave-8hhm krb5kdc[13967](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:31 dist-test-slave-8hhm krb5kdc[13967](info): set up 2 sockets
Aug 07 06:47:31 dist-test-slave-8hhm krb5kdc[13967](info): commencing operation
krb5kdc: starting...
W20260807 06:47:33.019986 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:33 dist-test-slave-8hhm krb5kdc[13967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:33.140242 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:41477
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:35771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:41477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:33.222390 13984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:33.222609 13984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:33.222631 13984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:33.223740 13984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:33.223776 13984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:33.223790 13984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:33.223803 13984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:33.223815 13984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:33.225274 13984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:35771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:41477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:41477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:33.225459 13984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:33.225625 13984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:33.230388 13994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:33.230499 13996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:33.230387 13992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:33.230572 13984 server_base.cc:1034] running on GCE node
I20260807 06:47:33.230940 13984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:33.231238 13984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:33.232403 13984 hybrid_clock.cc:648] HybridClock initialized: now 1786085253232400 us; error 39 us; skew 500 ppm
Aug 07 06:47:33 dist-test-slave-8hhm krb5kdc[13967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085253, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:33.234969 13984 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:33.235389 13984 webserver.cc:460] Webserver started at http://127.11.137.190:37263/ using document root <none> and password file <none>
I20260807 06:47:33.235605 13984 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:33.235670 13984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:33.235841 13984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:33.236845 13984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "45be38d535004b1b849479863022c642"
format_stamp: "Formatted at 2026-08-07 06:47:33 on dist-test-slave-8hhm"
server_key: "7af2267a3cc7fa9bdf2b665d73e31bac"
server_key_iv: "b06405cd6ab70a6da096b42c46ab29c6"
server_key_version: "encryptionkey@0"
I20260807 06:47:33.237257 13984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "45be38d535004b1b849479863022c642"
format_stamp: "Formatted at 2026-08-07 06:47:33 on dist-test-slave-8hhm"
server_key: "7af2267a3cc7fa9bdf2b665d73e31bac"
server_key_iv: "b06405cd6ab70a6da096b42c46ab29c6"
server_key_version: "encryptionkey@0"
I20260807 06:47:33.238654 13984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:33.239462 14008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:33.239634 13984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:33.239737 13984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "45be38d535004b1b849479863022c642"
format_stamp: "Formatted at 2026-08-07 06:47:33 on dist-test-slave-8hhm"
server_key: "7af2267a3cc7fa9bdf2b665d73e31bac"
server_key_iv: "b06405cd6ab70a6da096b42c46ab29c6"
server_key_version: "encryptionkey@0"
I20260807 06:47:33.239825 13984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:33.256078 13984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:33.257993 13984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:33.258154 13984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:33.262321 13984 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:41477
I20260807 06:47:33.262357 14079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:41477 every 8 connection(s)
I20260807 06:47:33.262682 13984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:33.263545 14080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:33.265163 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 13984
I20260807 06:47:33.265307 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:33.265506 11814 external_mini_cluster.cc:1428] Setting key 50d80c5016edd0b1f5014c7759c93186
I20260807 06:47:33.265978 14080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642: Bootstrap starting.
I20260807 06:47:33.266631 14080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:33.266937 14080 log.cc:824] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:33.267647 14080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642: No bootstrap required, opened a new log
I20260807 06:47:33.269510 14080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45be38d535004b1b849479863022c642" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41477 } }
I20260807 06:47:33.269663 14080 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:33.269712 14080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45be38d535004b1b849479863022c642, State: Initialized, Role: FOLLOWER
I20260807 06:47:33.269855 14080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45be38d535004b1b849479863022c642" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41477 } }
I20260807 06:47:33.269944 14080 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:33.269976 14080 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:33.270026 14080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:33.270752 14080 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45be38d535004b1b849479863022c642" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41477 } }
I20260807 06:47:33.270869 14080 leader_election.cc:302] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45be38d535004b1b849479863022c642; no voters:
I20260807 06:47:33.271044 14080 leader_election.cc:288] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:33.271096 14087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:33.271245 14087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [term 1 LEADER]: Becoming Leader. State: Replica: 45be38d535004b1b849479863022c642, State: Running, Role: LEADER
I20260807 06:47:33.271318 14080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:33.271373 14087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45be38d535004b1b849479863022c642" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41477 } }
I20260807 06:47:33.271785 14087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45be38d535004b1b849479863022c642. Latest consensus state: current_term: 1 leader_uuid: "45be38d535004b1b849479863022c642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45be38d535004b1b849479863022c642" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41477 } } }
I20260807 06:47:33.271792 14090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45be38d535004b1b849479863022c642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45be38d535004b1b849479863022c642" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 41477 } } }
I20260807 06:47:33.271940 14090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:33.272142 14087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642 [sys.catalog]: This master's current role is: LEADER
Aug 07 06:47:33 dist-test-slave-8hhm krb5kdc[13967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:33.272491 14096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:33.273017 14096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:33.275046 14096 catalog_manager.cc:1347] Generated new cluster ID: 1f86e5cefabc4f4d8793e274d18d3077
I20260807 06:47:33.275099 14096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:33.276474 14083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:33.266027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39131 (local address 127.11.137.190:41477)
0807 06:47:33.266203 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:33.266212 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:33.266243 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:47:33.266656 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:33.266661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:33.266742 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:33.266899 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:33.267568 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:33.268501 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:33.269338 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:33.269802 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:33.269916 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:33.272843 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:33.272846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:33.272847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:33.272858 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:33.274838 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:33.275263 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:33.275266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:33.275266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:33.275365 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:33.275584 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:33.275585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:33.275585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:33.275874 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:33.276003 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:33.276153 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 06:47:33.276279 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260807 06:47:33.277462 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:33.284837 14096 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:33.285593 14096 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:33.285811 14083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:33.278869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38151 (local address 127.11.137.190:41477)
0807 06:47:33.278905 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:33.278906 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:33.278957 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:47:33.279034 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:33.279034 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:33.279043 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:33.279066 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:33.279688 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:33.280371 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:33.281325 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:33.281626 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:33.281659 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:33.282996 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:33.282998 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:33.282998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:33.283004 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:33.284509 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:33.284943 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:33.284944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:33.284945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:33.285008 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:33.285233 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:33.285233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:33.285234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:33.285348 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:33.285410 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:33.285636 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 06:47:33.285731 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:47:33.291108 14096 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45be38d535004b1b849479863022c642: Generated new TSK 0
I20260807 06:47:33.291286 14096 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:33.297044 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 13984
2026-08-07T06:47:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1521 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:33 dist-test-slave-8hhm krb5kdc[14129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:33 dist-test-slave-8hhm krb5kdc[14129](info): set up 2 sockets
Aug 07 06:47:33 dist-test-slave-8hhm krb5kdc[14129](info): commencing operation
krb5kdc: starting...
W20260807 06:47:34.526120 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:34 dist-test-slave-8hhm krb5kdc[14129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:34.649508 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:44147
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:46797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:44147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:34.729552 14149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:34.729789 14149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:34.729828 14149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:34.731014 14149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:34.731076 14149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:34.731101 14149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:34.731122 14149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:34.731165 14149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:34.732692 14149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:46797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:44147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:44147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:34.732970 14149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:34.733201 14149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:34.738134 14161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:34.738181 14159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:34.738134 14157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:34.738438 14149 server_base.cc:1034] running on GCE node
I20260807 06:47:34.738705 14149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:34.739042 14149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:34.740200 14149 hybrid_clock.cc:648] HybridClock initialized: now 1786085254740190 us; error 30 us; skew 500 ppm
Aug 07 06:47:34 dist-test-slave-8hhm krb5kdc[14129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085254, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:34.742702 14149 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:34.743163 14149 webserver.cc:460] Webserver started at http://127.11.137.190:40447/ using document root <none> and password file <none>
I20260807 06:47:34.743391 14149 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:34.743458 14149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:34.743618 14149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:34.744695 14149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "42916e3c13724344b60cb50e9283cb49"
format_stamp: "Formatted at 2026-08-07 06:47:34 on dist-test-slave-8hhm"
server_key: "32f72c62ff17657e61333bf9df8ba7a0"
server_key_iv: "71a05aa2aa99ec950c946c94619703fe"
server_key_version: "encryptionkey@0"
I20260807 06:47:34.745072 14149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "42916e3c13724344b60cb50e9283cb49"
format_stamp: "Formatted at 2026-08-07 06:47:34 on dist-test-slave-8hhm"
server_key: "32f72c62ff17657e61333bf9df8ba7a0"
server_key_iv: "71a05aa2aa99ec950c946c94619703fe"
server_key_version: "encryptionkey@0"
I20260807 06:47:34.746513 14149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:34.747279 14172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:34.747455 14149 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:34.747568 14149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "42916e3c13724344b60cb50e9283cb49"
format_stamp: "Formatted at 2026-08-07 06:47:34 on dist-test-slave-8hhm"
server_key: "32f72c62ff17657e61333bf9df8ba7a0"
server_key_iv: "71a05aa2aa99ec950c946c94619703fe"
server_key_version: "encryptionkey@0"
I20260807 06:47:34.747651 14149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:34.755846 14149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:34.757686 14149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:34.757848 14149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:34.762050 14149 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:44147
I20260807 06:47:34.762099 14250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:44147 every 8 connection(s)
I20260807 06:47:34.762444 14149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:34.763298 14251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:34.763932 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14149
I20260807 06:47:34.764068 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:34.764297 11814 external_mini_cluster.cc:1428] Setting key 18dd0648d53d4f544b1911d3f5a18d8a
I20260807 06:47:34.766360 14251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49: Bootstrap starting.
I20260807 06:47:34.767011 14251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:34.767333 14251 log.cc:824] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:34.768057 14251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49: No bootstrap required, opened a new log
I20260807 06:47:34.769698 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:34.764804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56815 (local address 127.11.137.190:44147)
0807 06:47:34.764983 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:34.764992 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:34.765022 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:47:34.765483 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:34.765490 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:34.765537 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:34.765647 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:34.765883 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:34.766818 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:34.767869 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:34.768283 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:34.768361 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:34.769012 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:34.769015 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:34.769015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:34.769192 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:34.769269 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:34.769285 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:34.769339 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:34.769437 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 06:47:34.769482 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260807 06:47:34.770411 14251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42916e3c13724344b60cb50e9283cb49" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44147 } }
I20260807 06:47:34.770573 14251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:34.770586 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:34.770612 14251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42916e3c13724344b60cb50e9283cb49, State: Initialized, Role: FOLLOWER
I20260807 06:47:34.770716 14251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42916e3c13724344b60cb50e9283cb49" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44147 } }
I20260807 06:47:34.770774 14251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:34.770798 14251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:34.770833 14251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:34.771540 14251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42916e3c13724344b60cb50e9283cb49" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44147 } }
I20260807 06:47:34.771642 14251 leader_election.cc:302] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42916e3c13724344b60cb50e9283cb49; no voters:
I20260807 06:47:34.771831 14251 leader_election.cc:288] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:34.771888 14262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:34.772040 14262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [term 1 LEADER]: Becoming Leader. State: Replica: 42916e3c13724344b60cb50e9283cb49, State: Running, Role: LEADER
I20260807 06:47:34.772082 14251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:34.772122 14262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42916e3c13724344b60cb50e9283cb49" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44147 } }
I20260807 06:47:34.772425 14264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42916e3c13724344b60cb50e9283cb49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42916e3c13724344b60cb50e9283cb49" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44147 } } }
I20260807 06:47:34.772526 14264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:34.772737 14272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:34.772415 14262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42916e3c13724344b60cb50e9283cb49. Latest consensus state: current_term: 1 leader_uuid: "42916e3c13724344b60cb50e9283cb49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42916e3c13724344b60cb50e9283cb49" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 44147 } } }
I20260807 06:47:34.772847 14262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49 [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:34.773454 14272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:34.775475 14272 catalog_manager.cc:1347] Generated new cluster ID: 147739ab2d0f4414b2be3af0e2d3beda
I20260807 06:47:34.775524 14272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:34.775800 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:34.772190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39987 (local address 127.11.137.190:44147)
0807 06:47:34.772221 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:34.772223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:34.772556 (+ 333us) server_negotiation.cc:407] Connection header received
0807 06:47:34.772584 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:34.772585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:34.772598 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:34.772651 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:34.772851 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:34.773596 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:34.774662 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:34.774849 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:34.774917 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:34.775555 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:34.775556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:34.775557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:34.775561 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:34.775573 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:34.775576 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:34.775627 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:34.775689 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 06:47:34.775710 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 06:47:34.804494 14272 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:34.805264 14272 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:34.810360 14272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42916e3c13724344b60cb50e9283cb49: Generated new TSK 0
I20260807 06:47:34.810568 14272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:34.821945 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14149
2026-08-07T06:47:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1535 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:34 dist-test-slave-8hhm krb5kdc[14294](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:34 dist-test-slave-8hhm krb5kdc[14294](info): set up 2 sockets
Aug 07 06:47:34 dist-test-slave-8hhm krb5kdc[14294](info): commencing operation
krb5kdc: starting...
W20260807 06:47:36.092271 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:36 dist-test-slave-8hhm krb5kdc[14294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:36.216048 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:34025
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:34025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:36.298656 14313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:36.298879 14313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:36.298916 14313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:36.300007 14313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:36.300073 14313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:36.300097 14313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:36.300117 14313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:36.300145 14313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:36.301618 14313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:34025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:34025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:36.301891 14313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:36.302136 14313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:36.307091 14326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:36.307071 14324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:36.307085 14328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:36.307451 14313 server_base.cc:1034] running on GCE node
I20260807 06:47:36.307770 14313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:36.308070 14313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:36.309332 14313 hybrid_clock.cc:648] HybridClock initialized: now 1786085256309319 us; error 42 us; skew 500 ppm
Aug 07 06:47:36 dist-test-slave-8hhm krb5kdc[14294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085256, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:36.311887 14313 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:36.312340 14313 webserver.cc:460] Webserver started at http://127.11.137.190:40919/ using document root <none> and password file <none>
I20260807 06:47:36.312517 14313 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:36.312558 14313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:36.312644 14313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:36.313681 14313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "8c62f58169624a9e8fb043d0fef6815e"
format_stamp: "Formatted at 2026-08-07 06:47:36 on dist-test-slave-8hhm"
server_key: "500f7e49a446ce67dc4467c348a47f8b"
server_key_iv: "e1dabe974795746242e573af4c02f2be"
server_key_version: "encryptionkey@0"
I20260807 06:47:36.313998 14313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "8c62f58169624a9e8fb043d0fef6815e"
format_stamp: "Formatted at 2026-08-07 06:47:36 on dist-test-slave-8hhm"
server_key: "500f7e49a446ce67dc4467c348a47f8b"
server_key_iv: "e1dabe974795746242e573af4c02f2be"
server_key_version: "encryptionkey@0"
I20260807 06:47:36.315266 14313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:47:36.315946 14336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:36.316157 14313 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:36.316247 14313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "8c62f58169624a9e8fb043d0fef6815e"
format_stamp: "Formatted at 2026-08-07 06:47:36 on dist-test-slave-8hhm"
server_key: "500f7e49a446ce67dc4467c348a47f8b"
server_key_iv: "e1dabe974795746242e573af4c02f2be"
server_key_version: "encryptionkey@0"
I20260807 06:47:36.316303 14313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:36.319458 14313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:36.321379 14313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:36.321483 14313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:36.325289 14313 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:34025
I20260807 06:47:36.325309 14416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:34025 every 8 connection(s)
I20260807 06:47:36.325640 14313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:36.326645 14418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:36.328845 14418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e: Bootstrap starting.
I20260807 06:47:36.329542 14418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:36.329846 14418 log.cc:824] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:36.330513 14418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e: No bootstrap required, opened a new log
I20260807 06:47:36.331331 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14313
I20260807 06:47:36.331411 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:36.331607 11814 external_mini_cluster.cc:1428] Setting key 7a2554638e6ce44df66e4de9628e55a1
I20260807 06:47:36.332434 14418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c62f58169624a9e8fb043d0fef6815e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34025 } }
I20260807 06:47:36.332590 14418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:47:36.332656 14418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c62f58169624a9e8fb043d0fef6815e, State: Initialized, Role: FOLLOWER
I20260807 06:47:36.332808 14418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c62f58169624a9e8fb043d0fef6815e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34025 } }
I20260807 06:47:36.332926 14418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:47:36.332973 14418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:47:36.333020 14418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:36.333809 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:36.332140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60971 (local address 127.11.137.190:34025)
0807 06:47:36.332361 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:36.332371 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:36.332403 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:47:36.332502 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:36.332508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:36.332531 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:36.332664 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:36.333398 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:36.333401 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:36.333402 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:36.333406 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:36.333452 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:36.333463 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:36.333535 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:36.333603 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 06:47:36.333643 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260807 06:47:36.333988 14418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c62f58169624a9e8fb043d0fef6815e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34025 } }
I20260807 06:47:36.334095 14418 leader_election.cc:302] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c62f58169624a9e8fb043d0fef6815e; no voters:
I20260807 06:47:36.334249 14418 leader_election.cc:288] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:47:36.334296 14424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:36.334481 14424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [term 1 LEADER]: Becoming Leader. State: Replica: 8c62f58169624a9e8fb043d0fef6815e, State: Running, Role: LEADER
I20260807 06:47:36.334571 14418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:36.334616 14424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c62f58169624a9e8fb043d0fef6815e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34025 } }
I20260807 06:47:36.334713 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:36.335005 14424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c62f58169624a9e8fb043d0fef6815e. Latest consensus state: current_term: 1 leader_uuid: "8c62f58169624a9e8fb043d0fef6815e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c62f58169624a9e8fb043d0fef6815e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34025 } } }
I20260807 06:47:36.335279 14424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:36.335198 14426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c62f58169624a9e8fb043d0fef6815e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c62f58169624a9e8fb043d0fef6815e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 34025 } } }
I20260807 06:47:36.335688 14426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:36.335829 14436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:36.336371 14436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:36.337924 14436 catalog_manager.cc:1347] Generated new cluster ID: 3685e4f3905a435da24f71e40bdd8d42
I20260807 06:47:36.337982 14436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:36.338937 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:36.337693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54443 (local address 127.11.137.190:34025)
0807 06:47:36.337741 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:36.337743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:36.338048 (+ 305us) server_negotiation.cc:407] Connection header received
0807 06:47:36.338142 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:36.338142 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:36.338148 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:36.338188 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:36.338699 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:36.338700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:36.338700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:47:36.338705 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:36.338718 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:47:36.338722 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:36.338778 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:36.338846 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 06:47:36.338859 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 06:47:36.371788 14436 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:36.371996 14436 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:36.381311 14436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c62f58169624a9e8fb043d0fef6815e: Generated new TSK 0
I20260807 06:47:36.381546 14436 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:36.390059 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14313
2026-08-07T06:47:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1565 ms)
[----------] 18 tests from AuthTokenIssuingTest (27631 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:36 dist-test-slave-8hhm krb5kdc[14458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:36 dist-test-slave-8hhm krb5kdc[14458](info): set up 2 sockets
Aug 07 06:47:36 dist-test-slave-8hhm krb5kdc[14458](info): commencing operation
krb5kdc: starting...
W20260807 06:47:37.640247 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:37 dist-test-slave-8hhm krb5kdc[14458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:37.760939 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39621
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:39621,127.11.137.189:41041,127.11.137.188:42549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:37.841899 14475 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:47:37.842104 14475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:37.842123 14475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:37.842140 14475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:37.843183 14475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:37.843214 14475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:37.843226 14475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:37.843238 14475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:37.843250 14475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:37.844610 14475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:39621,127.11.137.189:41041,127.11.137.188:42549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:39621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:37.844843 14475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:37.845052 14475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:37.849936 14487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:37.849967 14482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:37.850071 14475 server_base.cc:1034] running on GCE node
W20260807 06:47:37.850047 14484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:37.850435 14475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:37.850732 14475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:37.851879 14475 hybrid_clock.cc:648] HybridClock initialized: now 1786085257851860 us; error 40 us; skew 500 ppm
Aug 07 06:47:37 dist-test-slave-8hhm krb5kdc[14458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:37.857882 14475 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:37.858309 14475 webserver.cc:460] Webserver started at http://127.11.137.190:46783/ using document root <none> and password file <none>
I20260807 06:47:37.858536 14475 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:37.858608 14475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:37.858770 14475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:37.859829 14475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "0ab889d600534fe19f70c2d29cf3863e"
format_stamp: "Formatted at 2026-08-07 06:47:37 on dist-test-slave-8hhm"
server_key: "3bceb9916dd1d62954de60277f7ba3d3"
server_key_iv: "1a99b56d2a9ea057f5ef981c4c9a920b"
server_key_version: "encryptionkey@0"
I20260807 06:47:37.860212 14475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "0ab889d600534fe19f70c2d29cf3863e"
format_stamp: "Formatted at 2026-08-07 06:47:37 on dist-test-slave-8hhm"
server_key: "3bceb9916dd1d62954de60277f7ba3d3"
server_key_iv: "1a99b56d2a9ea057f5ef981c4c9a920b"
server_key_version: "encryptionkey@0"
I20260807 06:47:37.861642 14475 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:37.862404 14499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:37.862567 14475 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:37.862679 14475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "0ab889d600534fe19f70c2d29cf3863e"
format_stamp: "Formatted at 2026-08-07 06:47:37 on dist-test-slave-8hhm"
server_key: "3bceb9916dd1d62954de60277f7ba3d3"
server_key_iv: "1a99b56d2a9ea057f5ef981c4c9a920b"
server_key_version: "encryptionkey@0"
I20260807 06:47:37.862766 14475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:37.870318 14475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:37.872061 14475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:37.872231 14475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:37.876401 14475 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:39621
I20260807 06:47:37.876432 14588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:39621 every 8 connection(s)
I20260807 06:47:37.876803 14475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:37.877799 14589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:37.879348 14589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:47:37 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:37.885434 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14475
I20260807 06:47:37.885563 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:37.885776 11814 external_mini_cluster.cc:1428] Setting key 11e493bb47fbfc037ef44a0d555189f9
I20260807 06:47:37.889046 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:37.879994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39621 (local address 127.0.0.1:45054)
0807 06:47:37.880196 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:37.880231 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:37.880705 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:37.881081 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:37.881083 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:37.881393 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:37.881564 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:37.881568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:37.882606 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:37.882606 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:37.883251 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:37.883253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:37.883697 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:37.883697 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:37.883752 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:37.884307 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:37.884315 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:37.885855 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:37.887563 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:37.887569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:37.887571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:37.887782 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:37.888021 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:37.888022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:37.888022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:37.888112 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:37.888470 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:37.888476 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:37.888536 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 06:47:37.888639 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:47:37.888880 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":100,"thread_start_us":97,"threads_started":1}
I20260807 06:47:37.889046 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:37.880063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45054 (local address 127.11.137.190:39621)
0807 06:47:37.880862 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:37.880866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:37.880892 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:47:37.880957 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:37.880959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:37.880974 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:37.881050 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:37.881655 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:37.882498 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:37.883329 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:37.883617 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:37.883694 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:37.885925 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:37.885933 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:37.885933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:37.885940 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:37.887460 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:37.887865 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:37.887868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:37.887868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:37.887950 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:37.888193 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:37.888194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:37.888194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:37.888391 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:37.888478 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:37.888675 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 06:47:37.888815 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":67,"threads_started":1}
I20260807 06:47:37.889930 14589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:37.890322 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:37.890184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43340)
0807 06:47:37.890236 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:37.890287 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 06:47:37.890496 14506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
I20260807 06:47:37.890996 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:37.890872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43350)
0807 06:47:37.890931 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:37.890963 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 06:47:37.891172 14589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:41041: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.11.137.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab.
Entry for principal kudu/127.11.137.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab.
I20260807 06:47:37.917773 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:41041
--webserver_interface=127.11.137.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab
--principal=kudu/127.11.137.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:39621,127.11.137.189:41041,127.11.137.188:42549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:47:37.940415 14589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } attempt: 1
I20260807 06:47:37.940930 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:37.940763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43362)
0807 06:47:37.940840 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:37.940889 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:47:37.941372 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:37.941278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43372)
0807 06:47:37.941311 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:37.941339 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260807 06:47:37.941497 14589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:41041: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
W20260807 06:47:38.000989 14598 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:47:38.001279 14598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:38.001341 14598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:38.001384 14598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:38.002620 14598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:38.002694 14598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:38.002719 14598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:38.002741 14598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:38.002766 14598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:38.004261 14598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:39621,127.11.137.189:41041,127.11.137.188:42549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab
--principal=kudu/127.11.137.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:41041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.137.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:38.004554 14598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:38.004798 14598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:47:38.009681 14589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } attempt: 2
W20260807 06:47:38.009874 14606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:38.009886 14605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:38.010087 14598 server_base.cc:1034] running on GCE node
W20260807 06:47:38.010120 14610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:38.010165 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.010027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43388)
0807 06:47:38.010101 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.010129 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 06:47:38.010561 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.010461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43392)
0807 06:47:38.010514 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.010541 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 06:47:38.010586 14598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260807 06:47:38.010694 14589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:41041: Network error: Client connection negotiation failed: client connection to 127.11.137.189:41041: connect: Connection refused (error 111)
I20260807 06:47:38.010888 14598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:38.012035 14598 hybrid_clock.cc:648] HybridClock initialized: now 1786085258012015 us; error 35 us; skew 500 ppm
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:38.014573 14598 init.cc:377] Logged in from keytab as kudu/127.11.137.189@KRBTEST.COM (short username kudu)
I20260807 06:47:38.015046 14598 webserver.cc:460] Webserver started at http://127.11.137.189:45823/ using document root <none> and password file <none>
I20260807 06:47:38.015233 14598 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:38.015275 14598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:38.015365 14598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:38.016402 14598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data/instance:
uuid: "f01b367728124229814688ea56fd9fad"
format_stamp: "Formatted at 2026-08-07 06:47:38 on dist-test-slave-8hhm"
server_key: "cc64de0f4da769e5311dbec2e8584657"
server_key_iv: "e8644dcb73ca963b71dee259010e0880"
server_key_version: "encryptionkey@0"
I20260807 06:47:38.016722 14598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal/instance:
uuid: "f01b367728124229814688ea56fd9fad"
format_stamp: "Formatted at 2026-08-07 06:47:38 on dist-test-slave-8hhm"
server_key: "cc64de0f4da769e5311dbec2e8584657"
server_key_iv: "e8644dcb73ca963b71dee259010e0880"
server_key_version: "encryptionkey@0"
I20260807 06:47:38.018114 14598 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 06:47:38.018869 14620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:38.019083 14598 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:38.019209 14598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal
uuid: "f01b367728124229814688ea56fd9fad"
format_stamp: "Formatted at 2026-08-07 06:47:38 on dist-test-slave-8hhm"
server_key: "cc64de0f4da769e5311dbec2e8584657"
server_key_iv: "e8644dcb73ca963b71dee259010e0880"
server_key_version: "encryptionkey@0"
I20260807 06:47:38.019275 14598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:38.034732 14598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:38.037437 14598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:38.037552 14598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:38.041646 14598 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.189:41041
I20260807 06:47:38.041726 14687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.189:41041 every 8 connection(s)
I20260807 06:47:38.042045 14598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
I20260807 06:47:38.042732 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14598
I20260807 06:47:38.042814 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-1/wal/instance
I20260807 06:47:38.043020 11814 external_mini_cluster.cc:1428] Setting key e64ef425678d43cf1b3794e8c2726c7d
I20260807 06:47:38.043030 14688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:38.044641 14688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.137.188@KRBTEST.COM; defaulting to no policy
I20260807 06:47:38.054534 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.045522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.11.137.190:39621)
0807 06:47:38.045604 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.045606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.045874 (+ 268us) server_negotiation.cc:407] Connection header received
0807 06:47:38.046615 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.046617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.046629 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.046683 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.047542 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.048046 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.049170 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.049598 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.049681 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.051777 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.051779 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.051779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.051790 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.053331 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.053697 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.053698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.053698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.053754 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.053987 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.053988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.053988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.054108 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.054161 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.054394 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.054466 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:47:38.054765 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.045494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39621 (local address 127.0.0.1:45070)
0807 06:47:38.045695 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.045751 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.046509 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.046761 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.046765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.047136 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.047443 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.047450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.048139 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.048140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.049067 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.049070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.049695 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.049696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.049807 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.050325 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.050340 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.051657 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.053405 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.053412 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.053413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.053625 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.053826 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.053826 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.053827 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.053924 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.054167 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.054172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.054281 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.054384 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.054499 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.188@KRBTEST.COM" created.
I20260807 06:47:38.055401 14688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:38.063191 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.055761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43396 (local address 127.11.137.189:41041)
0807 06:47:38.055911 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.055916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.055941 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:47:38.055958 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.055959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.055970 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.056056 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.056336 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.057015 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.057794 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.058114 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.058209 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.060219 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.060226 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.060226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.060233 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.061853 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.062285 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.062288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.062288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.062343 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.062571 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.062571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.062572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.062698 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.062759 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.062941 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.063059 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260807 06:47:38.063197 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.055687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43396)
0807 06:47:38.055743 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.055754 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.055798 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.056055 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.056056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.056205 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.056248 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.056250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.057146 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.057147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.057690 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.057692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.058209 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.058210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.058273 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.058686 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.058690 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.060128 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.061949 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.061951 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.061951 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.062195 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.062420 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.062421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.062421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.062495 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.062775 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.062776 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.062824 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.062907 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.063011 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 06:47:38.063921 14688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:38.064316 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.064179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47112)
0807 06:47:38.064234 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.064285 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 06:47:38.064445 14621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
I20260807 06:47:38.064862 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.064756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47128)
0807 06:47:38.064812 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.064837 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 06:47:38.064980 14688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:42549: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab.
Entry for principal kudu/127.11.137.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab.
I20260807 06:47:38.072821 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:42549
--webserver_interface=127.11.137.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab
--principal=kudu/127.11.137.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:39621,127.11.137.189:41041,127.11.137.188:42549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:47:38.101841 14589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } attempt: 3
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:38.109095 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.102280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.11.137.189:41041)
0807 06:47:38.102362 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.102364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.102375 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:47:38.102424 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.102425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.102438 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.102508 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.102838 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.103309 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.104015 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.104246 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.104326 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.106386 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.106387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.106387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.106395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.107915 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.108276 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.108277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.108278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.108337 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.108546 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.108547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.108548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.108669 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.108747 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.108922 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.108999 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:47:38.109102 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.102208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43410)
0807 06:47:38.102263 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.102279 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.102363 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.102515 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.102516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.102681 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.102746 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.102747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.103409 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.103411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.103922 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.103923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.104338 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.104339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.104419 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.104903 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.104907 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.106291 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.108011 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.108013 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.108013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.108197 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.108414 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.108415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.108415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.108479 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.108750 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.108751 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.108799 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.108895 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.108998 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 06:47:38.109869 14589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:38.110226 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.110119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47130)
0807 06:47:38.110168 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.110197 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 06:47:38.110575 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.110486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47140)
0807 06:47:38.110529 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.110552 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 06:47:38.110669 14589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:42549: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
I20260807 06:47:38.114203 14688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } attempt: 1
I20260807 06:47:38.114609 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.114480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47144)
0807 06:47:38.114545 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.114582 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 06:47:38.114943 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.114851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47148)
0807 06:47:38.114895 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.114923 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 06:47:38.115041 14688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:42549: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
I20260807 06:47:38.141825 14589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } attempt: 1
I20260807 06:47:38.142383 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.142245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47164)
0807 06:47:38.142315 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.142355 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 06:47:38.142769 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.142683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47174)
0807 06:47:38.142728 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.142752 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 06:47:38.142910 14589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:42549: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
W20260807 06:47:38.157260 14703 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:47:38.157495 14703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:38.157513 14703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:38.157534 14703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:38.158676 14703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:38.158711 14703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:38.158725 14703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:38.158737 14703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:38.158749 14703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:38.160187 14703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:39621,127.11.137.189:41041,127.11.137.188:42549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab
--principal=kudu/127.11.137.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:42549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.137.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:38.160382 14703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:38.160544 14703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:38.165652 14710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:38.165637 14714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:38.165628 14716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:38.165633 14703 server_base.cc:1034] running on GCE node
I20260807 06:47:38.166137 14703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:38.166443 14703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:38.167632 14703 hybrid_clock.cc:648] HybridClock initialized: now 1786085258167630 us; error 41 us; skew 500 ppm
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:38.170162 14703 init.cc:377] Logged in from keytab as kudu/127.11.137.188@KRBTEST.COM (short username kudu)
I20260807 06:47:38.170581 14703 webserver.cc:460] Webserver started at http://127.11.137.188:41619/ using document root <none> and password file <none>
I20260807 06:47:38.170817 14703 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:38.170886 14703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:38.171034 14703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:38.172101 14703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data/instance:
uuid: "1ee00e3854204c08bab6eb79502da079"
format_stamp: "Formatted at 2026-08-07 06:47:38 on dist-test-slave-8hhm"
server_key: "d78e1314d502879c1f021ff819cf2020"
server_key_iv: "862f6446f47f1e00ba9954264884a019"
server_key_version: "encryptionkey@0"
I20260807 06:47:38.172482 14703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal/instance:
uuid: "1ee00e3854204c08bab6eb79502da079"
format_stamp: "Formatted at 2026-08-07 06:47:38 on dist-test-slave-8hhm"
server_key: "d78e1314d502879c1f021ff819cf2020"
server_key_iv: "862f6446f47f1e00ba9954264884a019"
server_key_version: "encryptionkey@0"
I20260807 06:47:38.173874 14703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 06:47:38.174579 14724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:38.174752 14703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:38.174853 14703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal
uuid: "1ee00e3854204c08bab6eb79502da079"
format_stamp: "Formatted at 2026-08-07 06:47:38 on dist-test-slave-8hhm"
server_key: "d78e1314d502879c1f021ff819cf2020"
server_key_iv: "862f6446f47f1e00ba9954264884a019"
server_key_version: "encryptionkey@0"
I20260807 06:47:38.174933 14703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:38.183157 14688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } attempt: 2
I20260807 06:47:38.183531 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.183411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47184)
0807 06:47:38.183470 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.183500 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 06:47:38.183835 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.183745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47198)
0807 06:47:38.183790 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.183813 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 06:47:38.183926 14688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:42549: Network error: Client connection negotiation failed: client connection to 127.11.137.188:42549: connect: Connection refused (error 111)
I20260807 06:47:38.185384 14703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:38.187156 14703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:38.187317 14703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:38.191691 14703 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.188:42549
I20260807 06:47:38.191733 14802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.188:42549 every 8 connection(s)
I20260807 06:47:38.192080 14703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
I20260807 06:47:38.192986 14803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:38.194520 14803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:38.197903 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 14703
I20260807 06:47:38.198086 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786084979847518-11814-0/minicluster-data/master-2/wal/instance
I20260807 06:47:38.198264 11814 external_mini_cluster.cc:1428] Setting key fda4393eff28adb6352835d233e50a0a
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:38.204319 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.195135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.11.137.190:39621)
0807 06:47:38.195217 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.195220 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.195373 (+ 153us) server_negotiation.cc:407] Connection header received
0807 06:47:38.195807 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.195809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.195819 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.195869 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.196397 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.196853 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.197991 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.198299 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.198391 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.201285 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.201287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.201287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.201294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.202831 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.203283 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.203285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.203285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.203345 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.203736 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.203737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.203737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.203895 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.203965 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.204194 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.204261 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:47:38.204516 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.195080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:39621 (local address 127.0.0.1:45080)
0807 06:47:38.195257 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.195291 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.195726 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.195919 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.195922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.196151 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.196328 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.196331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.196971 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.196972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.197827 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.197831 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.198468 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.198469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.198614 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.199228 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.199238 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.201131 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.202891 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.202898 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.202900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.203200 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.203535 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.203536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.203536 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.203641 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.203964 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.203968 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.204065 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.204137 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.204316 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:47:38.205256 14803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:38.208101 14808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.198667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47212 (local address 127.11.137.188:42549)
0807 06:47:38.198842 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.198846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.198954 (+ 108us) server_negotiation.cc:407] Connection header received
0807 06:47:38.198981 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.198983 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.199007 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.199095 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.199981 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.201007 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.202018 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.202491 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.202568 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.205269 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.205275 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.205275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.205285 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.206907 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.207283 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.207285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.207285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.207335 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.207531 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.207531 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.207531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.207649 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.207828 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.207923 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.207998 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:38.212147 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.205513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:41041 (local address 127.0.0.1:43424)
0807 06:47:38.205549 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.205558 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.205593 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.206007 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.206008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.206179 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.206229 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.206231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.206851 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.206852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.207627 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.207629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.207999 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.208001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.208079 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.208435 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.208440 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.209590 (+ 1150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.211095 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.211096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.211096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.211316 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.211552 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.211552 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.211552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.211609 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.211929 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.211929 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.211962 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.212014 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.212093 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260807 06:47:38.212265 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.205825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.11.137.189:41041)
0807 06:47:38.205879 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.205880 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.205887 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:47:38.205908 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.205909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.205916 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.206003 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.206295 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.206763 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.207712 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.207927 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.208001 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.209677 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.209679 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.209679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.209685 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.210989 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.211400 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.211401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.211402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.211464 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.211706 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.211708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.211708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.211852 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.211934 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.212044 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.212129 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:47:38.213012 14803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:38.216741 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.208932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45084 (local address 127.11.137.190:39621)
0807 06:47:38.208970 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.208972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.208981 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:38.209002 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.209002 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.209011 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.209055 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.209596 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.210119 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.210767 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.210966 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.211040 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.213614 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.213615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.213615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.213622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.215133 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.215551 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.215552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.215552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.215601 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.215765 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.215765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.215766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.215878 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.216477 (+ 599us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.216526 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.216621 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:47:38.218067 14589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } attempt: 2
I20260807 06:47:38.220715 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.213279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47218)
0807 06:47:38.213343 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.213353 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.213398 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.213512 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.213512 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.213620 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.213645 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.213646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.214473 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.214474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.215262 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.215265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.215778 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.215779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.215832 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.216206 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.216213 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.217615 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.219692 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.219692 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.219693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.219900 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.220121 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.220121 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.220121 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.220194 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.220453 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.220453 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.220489 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.220549 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.220643 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 06:47:38.220992 14808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.213304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47218 (local address 127.11.137.188:42549)
0807 06:47:38.213341 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.213343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.213391 (+ 48us) server_negotiation.cc:407] Connection header received
0807 06:47:38.213436 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.213437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.213446 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.213509 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.213733 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.214384 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.215353 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.215699 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.215766 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.217714 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.217716 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.217716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.217723 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.219604 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.219990 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.219990 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.219990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.220068 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.220259 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.220259 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.220260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.220375 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.220432 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.220852 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.220919 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:38.222831 14803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: Bootstrap starting.
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085257, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:47:38.223590 14803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:38.223934 14803 log.cc:824] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:38.224843 14803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: No bootstrap required, opened a new log
I20260807 06:47:38.225903 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.217869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43426 (local address 127.11.137.189:41041)
0807 06:47:38.217943 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.217945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.217954 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:38.217997 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.217998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.218007 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.218068 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.218698 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.219114 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.219817 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.220127 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.220188 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.222969 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.222971 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.222971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.222979 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.224711 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.225043 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.225044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.225044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.225099 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.225350 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.225351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.225352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.225476 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.225667 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.225711 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.225788 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:47:38.226662 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.218300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47226)
0807 06:47:38.218352 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.218364 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.218407 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.218647 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.218648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.219062 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.219105 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.219108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.220071 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.220072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.220782 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.220785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.221816 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.221817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.221881 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.222269 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.222274 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.223643 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.225433 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.225434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.225434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.225638 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.225944 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.225945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.225945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.226011 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.226355 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.226356 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.226405 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.226451 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.226541 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 06:47:38.227128 14803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.227276 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.218349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47226 (local address 127.11.137.188:42549)
0807 06:47:38.218509 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.218511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.218519 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:47:38.218539 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.218540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.218549 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.218622 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.219202 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.219994 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.220884 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.221714 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.222036 (+ 322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.223750 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.223751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.223751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.223759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.225351 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.225732 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.225733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.225733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.225792 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.226092 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.226093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.226094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.226258 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.226989 (+ 731us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.227069 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.227152 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260807 06:47:38.227361 14803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ee00e3854204c08bab6eb79502da079, State: Initialized, Role: FOLLOWER
I20260807 06:47:38.227674 14803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.227950 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:38.227944 14812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.228009 14803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:38.228015 14812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:38.229091 14589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e: Bootstrap starting.
I20260807 06:47:38.229910 14589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e: Neither blocks nor log segments found. Creating new log.
W20260807 06:47:38.230000 14828 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:47:38.230044 14828 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:47:38.229013 14544 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0ab889d600534fe19f70c2d29cf3863e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45084
I20260807 06:47:38.230247 14589 log.cc:824] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:38.231066 14589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e: No bootstrap required, opened a new log
I20260807 06:47:38.230113 14703 master_runner.cc:186] Error getting master registration for 127.11.137.190:39621: OK, instance_id { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" instance_seqno: 1786085257875168 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:47:38.232357 14703 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:47:38.232409 14589 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.232532 14589 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab889d600534fe19f70c2d29cf3863e, State: Initialized, Role: FOLLOWER
I20260807 06:47:38.232626 14589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.232908 14589 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:38.232939 14544 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 06:47:38.232893 14835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.233065 14544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:38.233109 14835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:38.233968 14544 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.234227 14544 leader_election.cc:288] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [CANDIDATE]: Term 1 election: Requested vote from peers f01b367728124229814688ea56fd9fad (127.11.137.189:41041), 1ee00e3854204c08bab6eb79502da079 (127.11.137.188:42549)
I20260807 06:47:38.235731 14767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0ab889d600534fe19f70c2d29cf3863e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1ee00e3854204c08bab6eb79502da079"
I20260807 06:47:38.235826 14767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:38.236431 14767 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ab889d600534fe19f70c2d29cf3863e in term 1.
I20260807 06:47:38.236672 14500 leader_election.cc:302] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ab889d600534fe19f70c2d29cf3863e, 1ee00e3854204c08bab6eb79502da079; no voters:
I20260807 06:47:38.235982 14475 master_runner.cc:186] Error getting master registration for 127.11.137.189:41041: OK, instance_id { permanent_uuid: "f01b367728124229814688ea56fd9fad" instance_seqno: 1786085258040432 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:47:38.238916 14475 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:47:38.238984 14835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:38.239113 14835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [term 1 LEADER]: Becoming Leader. State: Replica: 0ab889d600534fe19f70c2d29cf3863e, State: Running, Role: LEADER
I20260807 06:47:38.239210 14835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.239607 14835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ab889d600534fe19f70c2d29cf3863e. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.239703 14835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:38.240096 14865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:38.240574 14865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:38.245968 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.235580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43438 (local address 127.11.137.189:41041)
0807 06:47:38.235790 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.235792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.237286 (+ 1494us) server_negotiation.cc:407] Connection header received
0807 06:47:38.237312 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.237312 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.237322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.237377 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.238080 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.238815 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.239919 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.240239 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.240281 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.242070 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.242071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.242071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.242093 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.243747 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.244227 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.244228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.244229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.244289 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.245334 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.245336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.245336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.245463 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.245540 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.245763 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.245843 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193}
I20260807 06:47:38.250244 14767 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [term 1 FOLLOWER]: Refusing update from remote peer 0ab889d600534fe19f70c2d29cf3863e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:38.250702 14835 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:38.252072 14812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ab889d600534fe19f70c2d29cf3863e. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.252157 14812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:38.252851 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.236921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47242 (local address 127.11.137.188:42549)
0807 06:47:38.236956 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.236958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.241842 (+ 4884us) server_negotiation.cc:407] Connection header received
0807 06:47:38.241908 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.241908 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.241933 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.241983 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.243112 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.243861 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.245154 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.245487 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.245546 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.248479 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.248480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.248481 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.248490 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.250156 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.251658 (+ 1502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.251660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.251660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.251751 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.252212 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.252212 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.252213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.252348 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.252428 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.252671 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.252755 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 06:47:38.253453 14835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.253535 14835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:38.253968 14812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.254045 14812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:38.254134 14865 catalog_manager.cc:1347] Generated new cluster ID: 57446576266d4b9da1ad5a8fac9d9a1a
I20260807 06:47:38.254180 14865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:38.256610 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.235821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45090 (local address 127.11.137.190:39621)
0807 06:47:38.235859 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.235860 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.246004 (+ 10144us) server_negotiation.cc:407] Connection header received
0807 06:47:38.246325 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.246326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.246337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.246366 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.247112 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.247827 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.249907 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.250228 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.250266 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.253356 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.253357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.253357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.253365 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.255322 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.255710 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.255711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.255711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.255771 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.256011 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.256012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.256012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.256145 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.256228 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.256423 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.256510 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:47:38.259091 14868 mvcc.cc:205] Tried to move back new op lower bound from 7315805217789747200 to 7315805217748471808. Current Snapshot: MvccSnapshot[applied={T|T < 7315805217789747200 or (T in {7315805217789747200})}]
I20260807 06:47:38.260880 14869 mvcc.cc:205] Tried to move back new op lower bound from 7315805217789747200 to 7315805217748471808. Current Snapshot: MvccSnapshot[applied={T|T < 7315805217789747200}]
I20260807 06:47:38.261464 14865 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:38.262159 14865 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:38.272120 14865 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e: Generated new TSK 0
I20260807 06:47:38.272315 14865 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:47:38.275056 14688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } attempt: 3
Aug 07 06:47:38 dist-test-slave-8hhm krb5kdc[14458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085258, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:47:38.283538 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.275349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:42549 (local address 127.0.0.1:47248)
0807 06:47:38.275400 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:38.275411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:38.275449 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:38.275595 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:38.275597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:38.275807 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:38.275858 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.275860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.276734 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.276735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.277534 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:38.277537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.278056 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.278057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:38.278112 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.278605 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:38.278611 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:38.280219 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:38.282206 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.282207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.282208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.282454 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.282723 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:38.282725 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:38.282725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:38.282807 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:38.283160 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:38.283161 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:38.283223 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 06:47:38.283289 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:47:38.283401 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 06:47:38.283878 14810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:38.275398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47248 (local address 127.11.137.188:42549)
0807 06:47:38.275451 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.275452 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.275461 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:38.275507 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.275508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.275518 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.275578 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.275926 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.276667 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.277653 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:38.277934 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:38.277997 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:38.280313 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:38.280314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:38.280315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:38.280322 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:38.282100 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.282548 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.282550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.282550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.282638 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:38.282885 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:38.282886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:38.282887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:38.283038 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:38.283119 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:38.283717 (+ 598us) server_negotiation.cc:299] Negotiation successful
0807 06:47:38.283792 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 06:47:38.285539 14688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: Bootstrap starting.
I20260807 06:47:38.286274 14688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:38.286615 14688 log.cc:824] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:38.299144 14688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: No bootstrap required, opened a new log
I20260807 06:47:38.301344 14688 raft_consensus.cc:348] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.301492 14688 raft_consensus.cc:729] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f01b367728124229814688ea56fd9fad, State: Initialized, Role: FOLLOWER
I20260807 06:47:38.301594 14688 consensus_queue.cc:260] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } }
I20260807 06:47:38.301944 14688 sys_catalog.cc:564] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:38.302037 14652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0ab889d600534fe19f70c2d29cf3863e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f01b367728124229814688ea56fd9fad"
I20260807 06:47:38.302179 14651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:38.303710 14651 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [term 1 FOLLOWER]: Refusing update from remote peer 0ab889d600534fe19f70c2d29cf3863e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:38.304400 14835 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:38.305483 14652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ab889d600534fe19f70c2d29cf3863e in term 1.
I20260807 06:47:38.303918 14880 sys_catalog.cc:455] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.309056 14901 sys_catalog.cc:455] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ab889d600534fe19f70c2d29cf3863e. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.309178 14901 sys_catalog.cc:458] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:38.309305 14906 sys_catalog.cc:455] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.309361 14906 sys_catalog.cc:458] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:38.309073 14880 sys_catalog.cc:458] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad [sys.catalog]: This master's current role is: FOLLOWER
W20260807 06:47:38.309885 14899 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:47:38.309959 14899 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 06:47:38.321439 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.320031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.11.137.189:41041)
0807 06:47:38.320072 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.320074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.320750 (+ 676us) server_negotiation.cc:407] Connection header received
0807 06:47:38.320848 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.320849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.320860 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.320892 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.321367 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43452: BlockingRecv error: recv got EOF from 127.0.0.1:43452 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 06:47:38.322214 14593 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.320466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.11.137.190:39621)
0807 06:47:38.320506 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.320508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.321698 (+ 1190us) server_negotiation.cc:407] Connection header received
0807 06:47:38.321813 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.321814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.321825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.321852 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.322131 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45096: BlockingRecv error: recv got EOF from 127.0.0.1:45096 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 06:47:38.323233 14810 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.322538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47258 (local address 127.11.137.188:42549)
0807 06:47:38.322595 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.322597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.322751 (+ 154us) server_negotiation.cc:407] Connection header received
0807 06:47:38.322838 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.322840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.322850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.322878 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.323158 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47258: BlockingRecv error: recv got EOF from 127.0.0.1:47258 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 06:47:38.325071 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.324345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43462 (local address 127.11.137.189:41041)
0807 06:47:38.324376 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.324377 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.324590 (+ 213us) server_negotiation.cc:407] Connection header received
0807 06:47:38.324689 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.324690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.324707 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.324735 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.325030 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43462: BlockingRecv error: recv got EOF from 127.0.0.1:43462 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 06:47:38.328017 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.327249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43470 (local address 127.11.137.189:41041)
0807 06:47:38.327288 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.327290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.327532 (+ 242us) server_negotiation.cc:407] Connection header received
0807 06:47:38.327627 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.327628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.327637 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.327664 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.327974 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43470: BlockingRecv error: recv got EOF from 127.0.0.1:43470 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 06:47:38.331780 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.331016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43474 (local address 127.11.137.189:41041)
0807 06:47:38.331065 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.331067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.331247 (+ 180us) server_negotiation.cc:407] Connection header received
0807 06:47:38.331366 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.331367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.331377 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.331404 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.331724 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43474: BlockingRecv error: recv got EOF from 127.0.0.1:43474 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 06:47:38.337731 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.336883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43476 (local address 127.11.137.189:41041)
0807 06:47:38.336919 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.336921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.337185 (+ 264us) server_negotiation.cc:407] Connection header received
0807 06:47:38.337320 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.337321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.337331 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.337359 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.337689 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43476: BlockingRecv error: recv got EOF from 127.0.0.1:43476 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:47:38.347604 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.346776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.11.137.189:41041)
0807 06:47:38.346811 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.346813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.347068 (+ 255us) server_negotiation.cc:407] Connection header received
0807 06:47:38.347164 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.347165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.347189 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.347218 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.347548 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43482: BlockingRecv error: recv got EOF from 127.0.0.1:43482 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:47:38.365792 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.364810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43486 (local address 127.11.137.189:41041)
0807 06:47:38.364853 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.364855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.365135 (+ 280us) server_negotiation.cc:407] Connection header received
0807 06:47:38.365287 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.365288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.365300 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.365332 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.365735 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43486: BlockingRecv error: recv got EOF from 127.0.0.1:43486 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 06:47:38.402065 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.401201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43500 (local address 127.11.137.189:41041)
0807 06:47:38.401272 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.401275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.401497 (+ 222us) server_negotiation.cc:407] Connection header received
0807 06:47:38.401580 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.401581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.401595 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.401636 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.402004 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43500: BlockingRecv error: recv got EOF from 127.0.0.1:43500 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 06:47:38.468044 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.467232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43506 (local address 127.11.137.189:41041)
0807 06:47:38.467280 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.467282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.467373 (+ 91us) server_negotiation.cc:407] Connection header received
0807 06:47:38.467451 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.467452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.467463 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.467516 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.467960 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43506: BlockingRecv error: recv got EOF from 127.0.0.1:43506 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 06:47:38.598232 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.597368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43516 (local address 127.11.137.189:41041)
0807 06:47:38.597444 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.597447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.597545 (+ 98us) server_negotiation.cc:407] Connection header received
0807 06:47:38.597659 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.597660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.597673 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.597703 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.598165 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43516: BlockingRecv error: recv got EOF from 127.0.0.1:43516 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:47:38.852488 14835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ab889d600534fe19f70c2d29cf3863e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ab889d600534fe19f70c2d29cf3863e" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 39621 } } peers { permanent_uuid: "f01b367728124229814688ea56fd9fad" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 41041 } } peers { permanent_uuid: "1ee00e3854204c08bab6eb79502da079" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 42549 } } }
I20260807 06:47:38.852682 14835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab889d600534fe19f70c2d29cf3863e [sys.catalog]: This master's current role is: LEADER
W20260807 06:47:38.855931 14698 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:38.855346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43532 (local address 127.11.137.189:41041)
0807 06:47:38.855409 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:38.855411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:38.855470 (+ 59us) server_negotiation.cc:407] Connection header received
0807 06:47:38.855514 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:38.855515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:38.855526 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:38.855576 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:38.855888 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43532: BlockingRecv error: recv got EOF from 127.0.0.1:43532 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:47:39.230535 14828 catalog_manager.cc:1259] Loaded cluster ID: 57446576266d4b9da1ad5a8fac9d9a1a
I20260807 06:47:39.230646 14828 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: loading cluster ID for follower catalog manager: success
I20260807 06:47:39.231444 14828 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: acquiring CA information for follower catalog manager: success
I20260807 06:47:39.231833 14828 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1ee00e3854204c08bab6eb79502da079: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:47:39.310360 14899 catalog_manager.cc:1259] Loaded cluster ID: 57446576266d4b9da1ad5a8fac9d9a1a
I20260807 06:47:39.310442 14899 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: loading cluster ID for follower catalog manager: success
I20260807 06:47:39.311338 14899 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: acquiring CA information for follower catalog manager: success
I20260807 06:47:39.311687 14899 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f01b367728124229814688ea56fd9fad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:47:39.372174 15010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:39.369285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43548 (local address 127.11.137.189:41041)
0807 06:47:39.369414 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:39.369416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:39.369505 (+ 89us) server_negotiation.cc:407] Connection header received
0807 06:47:39.369612 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:39.369613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:39.369689 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:39.369784 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:39.369971 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.370491 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.371285 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.371492 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.371577 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:39.371804 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:39.371925 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:39.372023 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:39.372049 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 06:47:39.372079 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":54,"threads_started":1}
I20260807 06:47:39.376215 15018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:39.374086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47262 (local address 127.11.137.188:42549)
0807 06:47:39.374212 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:39.374214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:39.374224 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:47:39.374259 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:39.374260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:39.374294 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:39.374361 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:39.374465 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.374929 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.375574 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.375748 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.375796 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:39.375917 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:39.375999 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:39.376050 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:39.376086 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 06:47:39.376100 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":55,"threads_started":1}
I20260807 06:47:39.380582 15018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:39.378161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47272 (local address 127.11.137.188:42549)
0807 06:47:39.378206 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:39.378207 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:39.378377 (+ 170us) server_negotiation.cc:407] Connection header received
0807 06:47:39.378422 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:39.378423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:39.378433 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:39.378488 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:39.378644 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.379112 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.379906 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.380140 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.380208 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:39.380342 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:39.380370 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:39.380423 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:39.380496 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 06:47:39.380516 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 06:47:39.381413 15030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:39.378207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45104 (local address 127.11.137.190:39621)
0807 06:47:39.378312 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:39.378314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:39.378325 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:47:39.378408 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:39.378409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:39.378458 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:39.378533 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:39.378708 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.379199 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.380250 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.380585 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.380650 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:39.381033 (+ 383us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:39.381130 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:39.381190 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:39.381299 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 06:47:39.381324 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":54,"threads_started":1}
I20260807 06:47:39.382136 15010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:39.378226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43558 (local address 127.11.137.189:41041)
0807 06:47:39.378259 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:39.378262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:39.378501 (+ 239us) server_negotiation.cc:407] Connection header received
0807 06:47:39.378585 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:39.378586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:39.378596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:39.378648 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:39.379331 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.380047 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.381369 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:39.381662 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:39.381745 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:39.381891 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:39.381935 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:39.381984 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:39.382026 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 06:47:39.382048 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 06:47:39.383121 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14475
I20260807 06:47:39.399767 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14598
I20260807 06:47:39.409192 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 14703
2026-08-07T06:47:39Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3012 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:47:39 dist-test-slave-8hhm krb5kdc[15035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:47:39 dist-test-slave-8hhm krb5kdc[15035](info): set up 2 sockets
Aug 07 06:47:39 dist-test-slave-8hhm krb5kdc[15035](info): commencing operation
krb5kdc: starting...
W20260807 06:47:40.650125 11814 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/test-user.keytab.
Aug 07 06:47:40 dist-test-slave-8hhm krb5kdc[15035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:47:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.137.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
Entry for principal kudu/127.11.137.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab.
I20260807 06:47:40.771515 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:43623
--webserver_interface=127.11.137.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:43623,127.11.137.189:35167,127.11.137.188:38331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:47:40.853430 15051 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:47:40.853662 15051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:40.853693 15051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:40.853736 15051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:40.854903 15051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:40.854971 15051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:40.854993 15051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:40.855014 15051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:40.855046 15051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:40.856556 15051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:43623,127.11.137.189:35167,127.11.137.188:38331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.190.keytab
--principal=kudu/127.11.137.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.190:43623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.137.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:40.856846 15051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:40.857097 15051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:40.862012 15065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:40.862011 15061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:40.862043 15062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:40.862288 15051 server_base.cc:1034] running on GCE node
I20260807 06:47:40.862574 15051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:40.862864 15051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:40.864006 15051 hybrid_clock.cc:648] HybridClock initialized: now 1786085260863992 us; error 29 us; skew 500 ppm
Aug 07 06:47:40 dist-test-slave-8hhm krb5kdc[15035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:40.866680 15051 init.cc:377] Logged in from keytab as kudu/127.11.137.190@KRBTEST.COM (short username kudu)
I20260807 06:47:40.867128 15051 webserver.cc:460] Webserver started at http://127.11.137.190:41805/ using document root <none> and password file <none>
I20260807 06:47:40.867376 15051 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:40.867422 15051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:40.867578 15051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:40.868654 15051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data/instance:
uuid: "726dfbc8804b44129c959b939869470f"
format_stamp: "Formatted at 2026-08-07 06:47:40 on dist-test-slave-8hhm"
server_key: "49f2273d243059c7495c671dc125f9d8"
server_key_iv: "f7f7292294532e1c982820ec92630cf8"
server_key_version: "encryptionkey@0"
I20260807 06:47:40.869028 15051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal/instance:
uuid: "726dfbc8804b44129c959b939869470f"
format_stamp: "Formatted at 2026-08-07 06:47:40 on dist-test-slave-8hhm"
server_key: "49f2273d243059c7495c671dc125f9d8"
server_key_iv: "f7f7292294532e1c982820ec92630cf8"
server_key_version: "encryptionkey@0"
I20260807 06:47:40.870421 15051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:47:40.871150 15079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:40.871328 15051 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:40.871434 15051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal
uuid: "726dfbc8804b44129c959b939869470f"
format_stamp: "Formatted at 2026-08-07 06:47:40 on dist-test-slave-8hhm"
server_key: "49f2273d243059c7495c671dc125f9d8"
server_key_iv: "f7f7292294532e1c982820ec92630cf8"
server_key_version: "encryptionkey@0"
I20260807 06:47:40.871519 15051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:40.885375 15051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:40.888587 15051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:40.888726 15051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:40.892908 15051 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.190:43623
I20260807 06:47:40.892968 15157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.190:43623 every 8 connection(s)
I20260807 06:47:40.893383 15051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/data/info.pb
I20260807 06:47:40.894294 15158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:40.895850 15158 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:40.896450 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15051
I20260807 06:47:40.896564 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-0/wal/instance
I20260807 06:47:40.896782 11814 external_mini_cluster.cc:1428] Setting key 63d80d170e1a73ed63764d37eb0fd3f2
Aug 07 06:47:40 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.137.189@KRBTEST.COM; defaulting to no policy
I20260807 06:47:40.906776 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:40.896563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:43623 (local address 127.0.0.1:50438)
0807 06:47:40.896766 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:40.896815 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:40.897581 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:40.897903 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:40.897905 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:40.898292 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:40.898514 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:40.898520 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:40.899591 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:40.899593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:40.900709 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:40.900712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:40.901167 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:40.901168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:40.901292 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:40.901848 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:40.901859 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:40.903452 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:40.905273 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:40.905280 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:40.905281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:40.905476 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:40.905745 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:40.905746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:40.905746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:40.905832 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:40.906199 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:40.906204 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:40.906266 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 06:47:40.906366 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 06:47:40.906528 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260807 06:47:40.906785 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:40.896775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50438 (local address 127.11.137.190:43623)
0807 06:47:40.896884 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:40.896889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:40.896921 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:47:40.897757 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:40.897760 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:40.897777 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:40.897855 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:40.898624 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:40.899478 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:40.900790 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:40.901078 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:40.901154 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:40.903547 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:40.903555 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:40.903555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:40.903562 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:40.905123 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:40.905570 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:40.905573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:40.905574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:40.905681 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:40.905903 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:40.905904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:40.905904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:40.906106 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:40.906218 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:40.906414 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 06:47:40.906598 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":82,"thread_start_us":46,"threads_started":1}
I20260807 06:47:40.907563 15158 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:40.907905 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:40.907783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55406)
0807 06:47:40.907832 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:40.907876 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 06:47:40.908047 15082 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
I20260807 06:47:40.908412 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:40.908317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55418)
0807 06:47:40.908368 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:40.908391 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.189@KRBTEST.COM" created.
W20260807 06:47:40.908532 15158 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:35167: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab.
Entry for principal kudu/127.11.137.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab.
I20260807 06:47:40.923736 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:35167
--webserver_interface=127.11.137.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab
--principal=kudu/127.11.137.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:43623,127.11.137.189:35167,127.11.137.188:38331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:47:40.957767 15158 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } attempt: 1
I20260807 06:47:40.958240 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:40.958108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55432)
0807 06:47:40.958169 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:40.958211 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 06:47:40.958595 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:40.958497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55434)
0807 06:47:40.958543 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:40.958568 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 06:47:40.958681 15158 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:35167: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
W20260807 06:47:41.005414 15167 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:47:41.005617 15167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:41.005635 15167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:41.005656 15167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:41.006858 15167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:41.006902 15167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:41.006916 15167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:41.006976 15167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:41.006994 15167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:41.008461 15167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:43623,127.11.137.189:35167,127.11.137.188:38331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.189.keytab
--principal=kudu/127.11.137.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.189:35167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.137.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:41.008725 15167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:41.008955 15167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:47:41.013947 15179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:41.014108 15167 server_base.cc:1034] running on GCE node
W20260807 06:47:41.013947 15176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:41.014000 15175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:41.014441 15167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:41.014698 15167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:41.015834 15167 hybrid_clock.cc:648] HybridClock initialized: now 1786085261015823 us; error 26 us; skew 500 ppm
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:41.018362 15167 init.cc:377] Logged in from keytab as kudu/127.11.137.189@KRBTEST.COM (short username kudu)
I20260807 06:47:41.018853 15167 webserver.cc:460] Webserver started at http://127.11.137.189:42813/ using document root <none> and password file <none>
I20260807 06:47:41.019080 15167 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:41.019125 15167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:41.019305 15167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:41.020330 15167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data/instance:
uuid: "d360b36a9a394155a291c2f7259a8eba"
format_stamp: "Formatted at 2026-08-07 06:47:41 on dist-test-slave-8hhm"
server_key: "6a28e68e15b0a985189379cce6e65c6a"
server_key_iv: "81ed296fa4897c8f0a36ad02d093cb3a"
server_key_version: "encryptionkey@0"
I20260807 06:47:41.020735 15167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal/instance:
uuid: "d360b36a9a394155a291c2f7259a8eba"
format_stamp: "Formatted at 2026-08-07 06:47:41 on dist-test-slave-8hhm"
server_key: "6a28e68e15b0a985189379cce6e65c6a"
server_key_iv: "81ed296fa4897c8f0a36ad02d093cb3a"
server_key_version: "encryptionkey@0"
I20260807 06:47:41.022166 15167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 06:47:41.022902 15186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:41.023111 15167 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 06:47:41.023205 15167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal
uuid: "d360b36a9a394155a291c2f7259a8eba"
format_stamp: "Formatted at 2026-08-07 06:47:41 on dist-test-slave-8hhm"
server_key: "6a28e68e15b0a985189379cce6e65c6a"
server_key_iv: "81ed296fa4897c8f0a36ad02d093cb3a"
server_key_version: "encryptionkey@0"
I20260807 06:47:41.023281 15167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:41.026813 15158 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } attempt: 2
I20260807 06:47:41.027168 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.027051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55438)
0807 06:47:41.027107 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.027142 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 06:47:41.027554 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.027467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55444)
0807 06:47:41.027511 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.027536 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 06:47:41.027657 15158 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.189:35167: Network error: Client connection negotiation failed: client connection to 127.11.137.189:35167: connect: Connection refused (error 111)
I20260807 06:47:41.031072 15167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:41.032804 15167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:41.032956 15167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:41.037034 15167 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.189:35167
I20260807 06:47:41.037086 15269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.189:35167 every 8 connection(s)
I20260807 06:47:41.037441 15167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/data/info.pb
I20260807 06:47:41.038286 15270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:41.038574 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15167
I20260807 06:47:41.038694 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-1/wal/instance
I20260807 06:47:41.038905 11814 external_mini_cluster.cc:1428] Setting key 4002cca43f9a83af32b953e6cccc7640
I20260807 06:47:41.040666 15270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.137.188@KRBTEST.COM; defaulting to no policy
I20260807 06:47:41.051258 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.041539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50452 (local address 127.11.137.190:43623)
0807 06:47:41.041607 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.041610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.041866 (+ 256us) server_negotiation.cc:407] Connection header received
0807 06:47:41.042624 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.042625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.042638 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.042685 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.043549 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.044146 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.045761 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.045953 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.046003 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.048399 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.048401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.048401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.048409 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.049862 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.050288 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.050289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.050290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.050352 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.050605 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.050606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.050607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.050730 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.050805 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.051082 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.051168 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.137.188@KRBTEST.COM" created.
I20260807 06:47:41.051445 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.041514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:43623 (local address 127.0.0.1:50452)
0807 06:47:41.041698 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.041749 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.042504 (+ 755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.042758 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.042762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.043185 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.043458 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.043465 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.044254 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.044255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.045661 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.045665 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.046040 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.046042 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.046201 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.046727 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.046739 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.048300 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.049963 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.049970 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.049972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.050205 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.050428 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.050429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.050430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.050536 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.050809 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.050817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.050946 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.051048 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.051209 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260807 06:47:41.051985 15270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:41.060753 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.052268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55456)
0807 06:47:41.052327 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.052339 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.052383 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.053715 (+ 1332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.053716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.053852 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.053893 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.053895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.054746 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.054747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.055289 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.055291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.055989 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.055990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.056044 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.056472 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.056476 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.057677 (+ 1201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.059783 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.059784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.059784 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.059945 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.060191 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.060192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.060192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.060243 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.060523 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.060524 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.060558 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.060608 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.060686 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 06:47:41.060884 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.053403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55456 (local address 127.11.137.189:35167)
0807 06:47:41.053547 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.053551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.053570 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:47:41.053591 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.053593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.053610 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.053711 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.053979 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.054639 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.055397 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.055908 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.055993 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.057765 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.057774 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.057775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.057782 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.059697 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.060037 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.060040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.060040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.060114 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.060312 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.060317 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.060318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.060463 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.060531 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.060632 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.060736 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260807 06:47:41.061548 15270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:41.061977 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.061872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38230)
0807 06:47:41.061916 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.061960 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 06:47:41.062129 15187 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
I20260807 06:47:41.062572 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.062485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38246)
0807 06:47:41.062513 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.062542 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260807 06:47:41.062716 15270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:38331: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.137.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab.
Entry for principal kudu/127.11.137.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab.
I20260807 06:47:41.069065 11814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBunj0a/build/release/bin/kudu
/tmp/dist-test-taskBunj0a/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:38331
--webserver_interface=127.11.137.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab
--principal=kudu/127.11.137.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.137.148:42369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.137.190:43623,127.11.137.189:35167,127.11.137.188:38331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:47:41.111961 15270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } attempt: 1
I20260807 06:47:41.112460 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.112320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38248)
0807 06:47:41.112394 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.112430 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 06:47:41.112859 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.112724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38262)
0807 06:47:41.112783 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.112827 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 06:47:41.113019 15270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:38331: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
I20260807 06:47:41.118794 15158 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } attempt: 3
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:41.125947 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.119158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55472 (local address 127.11.137.189:35167)
0807 06:47:41.119222 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.119224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.119236 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:47:41.119301 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.119302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.119314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.119359 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.119700 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.120203 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.120923 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.121155 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.121264 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.123374 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.123375 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.123375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.123382 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.124792 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.125194 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.125195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.125195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.125300 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.125525 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.125526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.125526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.125627 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.125682 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.125829 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.125888 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:47:41.126011 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.119098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55472)
0807 06:47:41.119146 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.119158 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.119231 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.119373 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.119374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.119539 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.119604 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.119605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.120293 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.120295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.120831 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.120833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.121261 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.121262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.121341 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.121831 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.121836 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.123286 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.124877 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.124878 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.124879 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.125109 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.125366 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.125367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.125367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.125456 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.125676 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.125677 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.125732 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.125812 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.125913 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 06:47:41.126497 15158 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:41.126858 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.126739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38270)
0807 06:47:41.126805 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.126837 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 06:47:41.127166 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.127068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38286)
0807 06:47:41.127117 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.127141 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 06:47:41.127260 15158 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:38331: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
W20260807 06:47:41.153489 15280 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:47:41.153713 15280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:47:41.153774 15280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:47:41.153818 15280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:47:41.154932 15280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:47:41.155002 15280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:47:41.155030 15280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:47:41.155067 15280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:47:41.155094 15280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:47:41.156569 15280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.137.148:42369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.137.190:43623,127.11.137.189:35167,127.11.137.188:38331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/krb5kdc/kudu_127.11.137.188.keytab
--principal=kudu/127.11.137.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.137.188:38331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.137.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 05:48:25 UTC on ccycloud.quasar-xmejrm.root.comops.site
build id 4571899
I20260807 06:47:41.156854 15280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:47:41.157096 15280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:47:41.158381 15158 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } attempt: 1
I20260807 06:47:41.158823 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.158696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38294)
0807 06:47:41.158757 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.158795 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 06:47:41.159128 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.159033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38308)
0807 06:47:41.159081 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.159106 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 06:47:41.159229 15158 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:38331: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
W20260807 06:47:41.162302 15294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:41.162309 15291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:47:41.162341 15292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:47:41.162626 15280 server_base.cc:1034] running on GCE node
I20260807 06:47:41.162866 15280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:47:41.163179 15280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:47:41.164350 15280 hybrid_clock.cc:648] HybridClock initialized: now 1786085261164338 us; error 29 us; skew 500 ppm
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:47:41.166837 15280 init.cc:377] Logged in from keytab as kudu/127.11.137.188@KRBTEST.COM (short username kudu)
I20260807 06:47:41.167268 15280 webserver.cc:460] Webserver started at http://127.11.137.188:38985/ using document root <none> and password file <none>
I20260807 06:47:41.167506 15280 fs_manager.cc:359] Metadata directory not provided
I20260807 06:47:41.167578 15280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:47:41.167729 15280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:47:41.168790 15280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data/instance:
uuid: "49307d9a75c24e748a70381d6c9a3815"
format_stamp: "Formatted at 2026-08-07 06:47:41 on dist-test-slave-8hhm"
server_key: "4af3cac426e36014684f23ce72285bb3"
server_key_iv: "487082a9476195ee600e2b5e706ecd91"
server_key_version: "encryptionkey@0"
I20260807 06:47:41.169158 15280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal/instance:
uuid: "49307d9a75c24e748a70381d6c9a3815"
format_stamp: "Formatted at 2026-08-07 06:47:41 on dist-test-slave-8hhm"
server_key: "4af3cac426e36014684f23ce72285bb3"
server_key_iv: "487082a9476195ee600e2b5e706ecd91"
server_key_version: "encryptionkey@0"
I20260807 06:47:41.170531 15280 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:47:41.171226 15302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:47:41.171384 15280 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 06:47:41.171484 15280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data,/tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal
uuid: "49307d9a75c24e748a70381d6c9a3815"
format_stamp: "Formatted at 2026-08-07 06:47:41 on dist-test-slave-8hhm"
server_key: "4af3cac426e36014684f23ce72285bb3"
server_key_iv: "487082a9476195ee600e2b5e706ecd91"
server_key_version: "encryptionkey@0"
I20260807 06:47:41.171566 15280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:47:41.181181 15270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } attempt: 2
I20260807 06:47:41.181607 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.181478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38322)
0807 06:47:41.181543 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.181577 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 06:47:41.181977 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.181890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38326)
0807 06:47:41.181935 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.181959 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 06:47:41.182080 15270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.137.188:38331: Network error: Client connection negotiation failed: client connection to 127.11.137.188:38331: connect: Connection refused (error 111)
I20260807 06:47:41.194476 15280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:47:41.196290 15280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:47:41.196403 15280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:47:41.200583 15280 rpc_server.cc:307] RPC server started. Bound to: 127.11.137.188:38331
I20260807 06:47:41.200634 15373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.137.188:38331 every 8 connection(s)
I20260807 06:47:41.200990 15280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/data/info.pb
I20260807 06:47:41.201956 15375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:47:41.203480 15375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:41.204663 11814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBunj0a/build/release/bin/kudu as pid 15280
I20260807 06:47:41.204773 11814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBunj0a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786084979847518-11814-0/minicluster-data/master-2/wal/instance
I20260807 06:47:41.204985 11814 external_mini_cluster.cc:1428] Setting key 60d9e0ee0cc94a3e426509e458027199
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:47:41.213639 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.204247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50466 (local address 127.11.137.190:43623)
0807 06:47:41.204320 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.204322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.204589 (+ 267us) server_negotiation.cc:407] Connection header received
0807 06:47:41.205270 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.205272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.205285 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.205354 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.206180 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.206773 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.207738 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.207923 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.207977 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.210486 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.210488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.210488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.210496 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.212095 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.212595 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.212597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.212597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.212662 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.212939 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.212940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.212940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.213108 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.213198 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.213492 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.213571 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:47:41.213871 15378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.204163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.190:43623 (local address 127.0.0.1:50466)
0807 06:47:41.204378 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.204419 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.205141 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.205446 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.205449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.205843 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.206086 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.206092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.206862 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.206863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.207641 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.207643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.208007 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.208008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.208157 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.208717 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.208725 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.210391 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.212179 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.212185 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.212186 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.212503 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.212738 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.212738 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.212739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.212843 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.213192 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.213197 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.213352 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.213437 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.213616 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":91,"threads_started":1}
I20260807 06:47:41.214454 15375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:41.214740 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.205430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.11.137.188:38331)
0807 06:47:41.205577 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.205581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.205660 (+ 79us) server_negotiation.cc:407] Connection header received
0807 06:47:41.205714 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.205716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.205736 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.205799 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.206496 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.207391 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.208346 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.208783 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.208838 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.211512 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.211521 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.211521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.211529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.213440 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.213843 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.213847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.213847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.213907 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.214142 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.214143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.214144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.214323 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.214455 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.214542 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.214619 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.190@KRBTEST.COM
I20260807 06:47:41.222738 15378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.214702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.189:35167 (local address 127.0.0.1:55476)
0807 06:47:41.214803 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.214813 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.214877 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.215078 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.215079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.215226 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.215292 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.215294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.216176 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.216177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.216906 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.216908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.217399 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.217400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.217461 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.217865 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.217870 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.219660 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.221497 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.221498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.221498 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.221730 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.222029 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.222030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.222030 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.222100 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.222425 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.222426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.222473 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.222551 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.222636 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 06:47:41.222832 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.214756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.11.137.189:35167)
0807 06:47:41.214800 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.214802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.214852 (+ 50us) server_negotiation.cc:407] Connection header received
0807 06:47:41.214956 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.214957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.214968 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.214998 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.215383 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.216101 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.216988 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.217328 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.217399 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.219771 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.219772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.219772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.219780 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.221408 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.221832 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.221833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.221833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.221920 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.222205 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.222206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.222207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.222343 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.222410 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.222584 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.222726 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 06:47:41.223173 15375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:47:41.224457 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.215548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50480 (local address 127.11.137.190:43623)
0807 06:47:41.215588 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.215590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.215596 (+ 6us) server_negotiation.cc:407] Connection header received
0807 06:47:41.215616 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.215616 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.215624 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.215671 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.216173 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.216864 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.217831 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.218124 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.218196 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.220893 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.220894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.220894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.220901 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.222562 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.223189 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.223190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.223191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.223258 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.223513 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.223514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.223514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.223629 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.224291 (+ 662us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.224330 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.224394 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.188@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.137.189@KRBTEST.COM
I20260807 06:47:41.230647 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.223467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38330 (local address 127.11.137.188:38331)
0807 06:47:41.223498 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.223500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.223535 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:47:41.223602 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.223603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.223612 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.223666 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.223905 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.224447 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.225345 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.225758 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.225838 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.227568 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.227569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.227570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.227577 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.229389 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.229779 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.229780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.229780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.229831 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.230030 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.230031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.230031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.230165 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.230233 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.230434 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.230555 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":16}
I20260807 06:47:41.230664 15378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.223457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38330)
0807 06:47:41.223495 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.223506 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.223549 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.223677 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.223677 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.223805 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.223828 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.223830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.224538 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.224539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.225271 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.225273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.225840 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.225841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.225905 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.226316 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.226321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.227485 (+ 1164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.229491 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.229491 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.229492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.229673 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.229906 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.229907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.229907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.229965 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.230241 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.230242 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.230304 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.230388 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.230509 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 06:47:41.232105 15375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: Bootstrap starting.
I20260807 06:47:41.232885 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.225119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55486 (local address 127.11.137.189:35167)
0807 06:47:41.225163 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.225165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.225198 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:47:41.225272 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.225273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.225283 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.225331 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.225909 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.226547 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.227331 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.227585 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.227666 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.229936 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.229937 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.229938 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.229945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.231634 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.232035 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.232036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.232036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.232096 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.232318 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.232319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.232319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.232449 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.232661 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.232701 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.232782 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:47:41.233116 15375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:41.233466 15375 log.cc:824] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:41.234367 15158 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } attempt: 2
I20260807 06:47:41.234449 15375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: No bootstrap required, opened a new log
I20260807 06:47:41.235020 11814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:47:41.236546 15375 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.236702 15375 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49307d9a75c24e748a70381d6c9a3815, State: Initialized, Role: FOLLOWER
I20260807 06:47:41.236784 15375 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.236040 15121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "726dfbc8804b44129c959b939869470f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50480
I20260807 06:47:41.237124 15375 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:41.237133 15388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.237365 15388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085260, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.190@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
W20260807 06:47:41.239348 15406 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:47:41.239530 15406 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:47:41.242547 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.234869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.11.137.188:38331)
0807 06:47:41.234933 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.234935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.234942 (+ 7us) server_negotiation.cc:407] Connection header received
0807 06:47:41.234959 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.234960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.234968 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.235057 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.235349 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.236057 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.236821 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.237148 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.237262 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.239359 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.239360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.239361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.239368 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.240941 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.241657 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.241658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.241659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.241717 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.241952 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.241953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.241953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.242140 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.242208 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.242378 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.242454 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:47:41.242564 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.234651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38332)
0807 06:47:41.234739 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.234750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.234785 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.235062 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.235064 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.235223 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.235265 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.235267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.236154 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.236156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.236718 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.236720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.237240 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.237242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.237307 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.237703 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.237709 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.239266 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.241330 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.241331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.241332 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.241588 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.241810 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.241811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.241812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.241883 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.242214 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.242215 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.242265 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.242339 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.242448 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 06:47:41.239982 15280 master_runner.cc:186] Error getting master registration for 127.11.137.190:43623: OK, instance_id { permanent_uuid: "726dfbc8804b44129c959b939869470f" instance_seqno: 1786085260891870 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:47:41.242795 15280 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:47:41.243933 15158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f: Bootstrap starting.
I20260807 06:47:41.244581 15158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:41.244903 15158 log.cc:824] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:41.245908 15158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f: No bootstrap required, opened a new log
I20260807 06:47:41.247361 15158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.247514 15158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726dfbc8804b44129c959b939869470f, State: Initialized, Role: FOLLOWER
I20260807 06:47:41.247605 15158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.247936 15158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:41.247958 15121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 06:47:41.248027 15121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:41.248930 15121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.249290 15121 leader_election.cc:288] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [CANDIDATE]: Term 1 election: Requested vote from peers d360b36a9a394155a291c2f7259a8eba (127.11.137.189:35167), 49307d9a75c24e748a70381d6c9a3815 (127.11.137.188:38331)
I20260807 06:47:41.249806 15342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "726dfbc8804b44129c959b939869470f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "49307d9a75c24e748a70381d6c9a3815"
I20260807 06:47:41.249940 15342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [term 0 FOLLOWER]: Advancing to term 1
W20260807 06:47:41.250348 15425 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:47:41.250392 15425 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:47:41.250849 15342 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726dfbc8804b44129c959b939869470f in term 1.
I20260807 06:47:41.251096 15081 leader_election.cc:302] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49307d9a75c24e748a70381d6c9a3815, 726dfbc8804b44129c959b939869470f; no voters:
I20260807 06:47:41.252895 15051 master_runner.cc:186] Error getting master registration for 127.11.137.189:35167: OK, instance_id { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" instance_seqno: 1786085261035887 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:47:41.255460 15051 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:47:41.247900 15409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.256111 15409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:41.256235 15409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:47:41.256340 15409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [term 1 LEADER]: Becoming Leader. State: Replica: 726dfbc8804b44129c959b939869470f, State: Running, Role: LEADER
I20260807 06:47:41.256500 15409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.257236 15409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 726dfbc8804b44129c959b939869470f. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.257417 15409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:41.261022 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.252364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38338 (local address 127.11.137.188:38331)
0807 06:47:41.252401 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.252403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.252524 (+ 121us) server_negotiation.cc:407] Connection header received
0807 06:47:41.252630 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.252631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.252641 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.252673 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.253602 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.254356 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.255478 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.255810 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.255859 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.257747 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.257748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.257748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.257756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.259662 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.260071 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.260072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.260073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.260133 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.260334 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.260335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.260335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.260454 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.260557 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.260809 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.260897 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 06:47:41.261754 15442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:47:41.262359 15442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:47:41.267822 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.252214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50488 (local address 127.11.137.190:43623)
0807 06:47:41.252260 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.252262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.257718 (+ 5456us) server_negotiation.cc:407] Connection header received
0807 06:47:41.257826 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.257827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.257837 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.257872 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.258605 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.259477 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.262044 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.262360 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.262424 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.264019 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.264021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.264022 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.264029 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.265996 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.266776 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.266777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.266778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.266847 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.267088 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.267089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.267090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.267236 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.267320 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.267606 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.267697 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 06:47:41.271839 15342 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [term 1 FOLLOWER]: Refusing update from remote peer 726dfbc8804b44129c959b939869470f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:41.272200 15409 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:41.273229 15270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } attempt: 3
I20260807 06:47:41.274308 15388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 726dfbc8804b44129c959b939869470f. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.274406 15388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:41.276400 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.255746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55500 (local address 127.11.137.189:35167)
0807 06:47:41.255791 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.255793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.260726 (+ 4933us) server_negotiation.cc:407] Connection header received
0807 06:47:41.260842 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.260843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.260856 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.260890 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.262283 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.263093 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.264897 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.265995 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.266051 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.268767 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.268768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.268768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.268776 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.270360 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.270823 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.270824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.270824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.270891 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.271143 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.271144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.271144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.271292 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.271386 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.276218 (+ 4832us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.276300 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 06:47:41.278430 15445 mvcc.cc:205] Tried to move back new op lower bound from 7315805230165549056 to 7315805230108004352. Current Snapshot: MvccSnapshot[applied={T|T < 7315805230165549056}]
I20260807 06:47:41.278765 15409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.278874 15409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: This master's current role is: LEADER
Aug 07 06:47:41 dist-test-slave-8hhm krb5kdc[15035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.137.189@KRBTEST.COM for kudu/127.11.137.188@KRBTEST.COM
I20260807 06:47:41.279421 15388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.279515 15388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:41.279690 15446 mvcc.cc:205] Tried to move back new op lower bound from 7315805230165549056 to 7315805230108004352. Current Snapshot: MvccSnapshot[applied={T|T < 7315805230165549056}]
I20260807 06:47:41.282989 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.273465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.137.188:38331 (local address 127.0.0.1:38346)
0807 06:47:41.273509 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 06:47:41.273518 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 06:47:41.273552 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:47:41.274706 (+ 1154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:47:41.274707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:47:41.274894 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:47:41.274933 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.274935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.275903 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.275905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.276751 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:47:41.276754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.277618 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.277619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:47:41.277705 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.278121 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:47:41.278142 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:47:41.279706 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:47:41.281843 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.281844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.281845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.282036 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.282280 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:47:41.282280 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:47:41.282281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:47:41.282343 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:47:41.282648 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:47:41.282649 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:47:41.282692 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 06:47:41.282768 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:47:41.282869 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 06:47:41.283257 15382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:41.274499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.11.137.188:38331)
0807 06:47:41.274546 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.274548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.274557 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:41.274579 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.274579 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.274589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.274654 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.275037 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.275829 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.277083 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:41.277449 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:41.277537 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:41.279824 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:47:41.279826 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:47:41.279826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:47:41.279833 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:47:41.281758 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.282135 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.282137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.282137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.282199 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:47:41.282414 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:47:41.282415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:47:41.282415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:47:41.282556 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:47:41.282619 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:41.282834 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 06:47:41.283022 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 06:47:41.285022 15270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: Bootstrap starting.
I20260807 06:47:41.285853 15270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: Neither blocks nor log segments found. Creating new log.
I20260807 06:47:41.286213 15270 log.cc:824] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: Log is configured to *not* fsync() on all Append() calls
I20260807 06:47:41.287178 15270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: No bootstrap required, opened a new log
I20260807 06:47:41.289430 15270 raft_consensus.cc:348] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.289579 15270 raft_consensus.cc:729] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d360b36a9a394155a291c2f7259a8eba, State: Initialized, Role: FOLLOWER
I20260807 06:47:41.289614 15442 catalog_manager.cc:1347] Generated new cluster ID: f3d1703287ed4958a66e9afc62a4ddc4
I20260807 06:47:41.289657 15442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:47:41.289678 15270 consensus_queue.cc:260] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } }
I20260807 06:47:41.290050 15270 sys_catalog.cc:564] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:47:41.290153 15231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:47:41.291172 15231 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [term 1 FOLLOWER]: Refusing update from remote peer 726dfbc8804b44129c959b939869470f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:47:41.291769 15430 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:47:41.291626 15232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "726dfbc8804b44129c959b939869470f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d360b36a9a394155a291c2f7259a8eba"
I20260807 06:47:41.293160 15471 sys_catalog.cc:455] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.294145 15471 sys_catalog.cc:458] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:41.294215 15471 sys_catalog.cc:455] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 726dfbc8804b44129c959b939869470f. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.294286 15471 sys_catalog.cc:458] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:41.294322 15471 sys_catalog.cc:455] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.294366 15471 sys_catalog.cc:458] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:47:41.294495 15232 raft_consensus.cc:2396] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 726dfbc8804b44129c959b939869470f for term 1 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 06:47:41.295946 15469 mvcc.cc:205] Tried to move back new op lower bound from 7315805230165549056 to 7315805230108004352. Current Snapshot: MvccSnapshot[applied={T|T < 7315805230165549056}]
I20260807 06:47:41.296262 15430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "726dfbc8804b44129c959b939869470f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726dfbc8804b44129c959b939869470f" member_type: VOTER last_known_addr { host: "127.11.137.190" port: 43623 } } peers { permanent_uuid: "d360b36a9a394155a291c2f7259a8eba" member_type: VOTER last_known_addr { host: "127.11.137.189" port: 35167 } } peers { permanent_uuid: "49307d9a75c24e748a70381d6c9a3815" member_type: VOTER last_known_addr { host: "127.11.137.188" port: 38331 } } }
I20260807 06:47:41.296344 15430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f [sys.catalog]: This master's current role is: LEADER
I20260807 06:47:41.297194 15442 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:47:41.297909 15442 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:47:41.304193 15442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 726dfbc8804b44129c959b939869470f: Generated new TSK 0
I20260807 06:47:41.304364 15442 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:47:41.305748 15467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:47:41.305812 15467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 06:47:41.336933 15163 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.335189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.11.137.190:43623)
0807 06:47:41.335235 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.335238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.336236 (+ 998us) server_negotiation.cc:407] Connection header received
0807 06:47:41.336351 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.336352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.336364 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.336398 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.336861 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51630: BlockingRecv error: recv got EOF from 127.0.0.1:51630 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 06:47:41.337896 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.335623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.11.137.189:35167)
0807 06:47:41.335673 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.335675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.337282 (+ 1607us) server_negotiation.cc:407] Connection header received
0807 06:47:41.337390 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.337391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.337402 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.337433 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.337834 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52934: BlockingRecv error: recv got EOF from 127.0.0.1:52934 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 06:47:41.338797 15382 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.335971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50084 (local address 127.11.137.188:38331)
0807 06:47:41.336026 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.336028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.338180 (+ 2152us) server_negotiation.cc:407] Connection header received
0807 06:47:41.338325 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.338326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.338337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.338370 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.338711 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50084: BlockingRecv error: recv got EOF from 127.0.0.1:50084 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 06:47:41.341267 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.340452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52944 (local address 127.11.137.189:35167)
0807 06:47:41.340502 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.340504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.340719 (+ 215us) server_negotiation.cc:407] Connection header received
0807 06:47:41.340828 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.340829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.340846 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.340877 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.341199 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52944: BlockingRecv error: recv got EOF from 127.0.0.1:52944 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 06:47:41.344337 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.343570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.11.137.189:35167)
0807 06:47:41.343605 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.343607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.343842 (+ 235us) server_negotiation.cc:407] Connection header received
0807 06:47:41.343941 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.343941 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.343951 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.343981 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.344295 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52956: BlockingRecv error: recv got EOF from 127.0.0.1:52956 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 06:47:41.348250 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.347469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.11.137.189:35167)
0807 06:47:41.347515 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.347517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.347746 (+ 229us) server_negotiation.cc:407] Connection header received
0807 06:47:41.347847 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.347847 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.347857 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.347887 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.348208 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52962: BlockingRecv error: recv got EOF from 127.0.0.1:52962 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260807 06:47:41.354171 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.353397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52964 (local address 127.11.137.189:35167)
0807 06:47:41.353434 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.353436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.353672 (+ 236us) server_negotiation.cc:407] Connection header received
0807 06:47:41.353771 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.353772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.353782 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.353812 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.354125 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52964: BlockingRecv error: recv got EOF from 127.0.0.1:52964 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 06:47:41.364089 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.363286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52974 (local address 127.11.137.189:35167)
0807 06:47:41.363320 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.363321 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.363573 (+ 252us) server_negotiation.cc:407] Connection header received
0807 06:47:41.363675 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.363676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.363685 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.363716 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.364031 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52974: BlockingRecv error: recv got EOF from 127.0.0.1:52974 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:47:41.382009 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.381237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52988 (local address 127.11.137.189:35167)
0807 06:47:41.381272 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.381274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.381524 (+ 250us) server_negotiation.cc:407] Connection header received
0807 06:47:41.381621 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.381622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.381632 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.381659 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.381965 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52988: BlockingRecv error: recv got EOF from 127.0.0.1:52988 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 06:47:41.416356 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.415379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52994 (local address 127.11.137.189:35167)
0807 06:47:41.415422 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.415424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.415744 (+ 320us) server_negotiation.cc:407] Connection header received
0807 06:47:41.415855 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.415856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.415869 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.415900 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.416294 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52994: BlockingRecv error: recv got EOF from 127.0.0.1:52994 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 06:47:41.482719 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.481952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53010 (local address 127.11.137.189:35167)
0807 06:47:41.482036 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.482039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.482175 (+ 136us) server_negotiation.cc:407] Connection header received
0807 06:47:41.482221 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.482222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.482234 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.482293 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.482648 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53010: BlockingRecv error: recv got EOF from 127.0.0.1:53010 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 06:47:41.612409 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.611755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.11.137.189:35167)
0807 06:47:41.611805 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.611807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.611909 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:47:41.611960 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.611961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.611972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.612038 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.612330 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53022: BlockingRecv error: recv got EOF from 127.0.0.1:53022 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 06:47:41.870605 15278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:47:41.869795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53032 (local address 127.11.137.189:35167)
0807 06:47:41.869875 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:41.869877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:41.869893 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:47:41.870015 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:41.870016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:41.870033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:41.870122 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:47:41.870535 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53032: BlockingRecv error: recv got EOF from 127.0.0.1:53032 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:47:42.240003 15406 catalog_manager.cc:1259] Loaded cluster ID: f3d1703287ed4958a66e9afc62a4ddc4
I20260807 06:47:42.240099 15406 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: loading cluster ID for follower catalog manager: success
I20260807 06:47:42.240953 15406 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: acquiring CA information for follower catalog manager: success
I20260807 06:47:42.241339 15406 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 49307d9a75c24e748a70381d6c9a3815: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:47:42.306299 15467 catalog_manager.cc:1259] Loaded cluster ID: f3d1703287ed4958a66e9afc62a4ddc4
I20260807 06:47:42.306378 15467 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: loading cluster ID for follower catalog manager: success
I20260807 06:47:42.307236 15467 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: acquiring CA information for follower catalog manager: success
I20260807 06:47:42.307565 15467 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d360b36a9a394155a291c2f7259a8eba: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:47:42.386626 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:42.384059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53048 (local address 127.11.137.189:35167)
0807 06:47:42.384188 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:42.384190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:42.384201 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:47:42.384263 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:42.384264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:42.384315 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:42.384402 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:42.384564 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.385086 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.385911 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.386100 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.386151 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:42.386321 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:42.386433 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:42.386493 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:42.386542 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 06:47:42.386560 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":73,"threads_started":1}
I20260807 06:47:42.390776 15581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:42.388451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50090 (local address 127.11.137.188:38331)
0807 06:47:42.388582 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:42.388583 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:42.388592 (+ 9us) server_negotiation.cc:407] Connection header received
0807 06:47:42.388628 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:42.388629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:42.388661 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:42.388747 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:42.388833 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.389366 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.390100 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.390282 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.390334 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:42.390443 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:42.390545 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:42.390600 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:42.390638 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 06:47:42.390654 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260807 06:47:42.395227 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:42.392559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.11.137.189:35167)
0807 06:47:42.392597 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:42.392599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:42.392607 (+ 8us) server_negotiation.cc:407] Connection header received
0807 06:47:42.392654 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:42.392655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:42.392664 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:42.392727 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:42.392879 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.393579 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.394507 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.394703 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.394777 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:42.394964 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:42.395003 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:42.395054 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:42.395112 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 06:47:42.395133 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 06:47:42.395502 15581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:42.392686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50102 (local address 127.11.137.188:38331)
0807 06:47:42.392751 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:42.392753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:42.392883 (+ 130us) server_negotiation.cc:407] Connection header received
0807 06:47:42.392974 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:42.392975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:42.392985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:42.393044 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:42.393149 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.393759 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.394757 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.395031 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.395085 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:42.395252 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:42.395279 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:42.395305 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:42.395412 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 06:47:42.395435 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:47:42.395987 15588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:47:42.392477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.11.137.190:43623)
0807 06:47:42.392881 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 06:47:42.392883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 06:47:42.392992 (+ 109us) server_negotiation.cc:407] Connection header received
0807 06:47:42.393093 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:47:42.393094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:47:42.393140 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:47:42.393278 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:47:42.393372 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.394095 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.395020 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:47:42.395343 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:47:42.395400 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:47:42.395654 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:47:42.395759 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:47:42.395816 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:47:42.395889 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 06:47:42.395912 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":47,"threads_started":1}
I20260807 06:47:42.397789 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15051
I20260807 06:47:42.408999 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15167
I20260807 06:47:42.422959 11814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBunj0a/build/release/bin/kudu with pid 15280
2026-08-07T06:47:42Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3014 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6026 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (282576 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST